00000001:02000400:3.0F:1787781657.254707:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787781676.386026:0:3534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787781678.690215:0:3595:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 533 MB/s 00000001:01000000:3.0:1787781678.940554:0:3595:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 539 MB/s 00000001:01000000:1.0F:1787781679.191968:0:3595:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3651 MB/s 00000020:02000000:0.0F:1787781679.911027:0:3626:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_56_gf34a808 00000400:02000000:0.0:1787781680.966534:0:3641:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.116@tcp [8/256/0/180] 00008000:02000000:0.0:1787781684.763160:0:3791:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787781747.954590:0:5758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787781760.924075:0:6507:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787781760.924079:0:6507:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787781760.924081:0:6507:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787781760.924463:0:6507:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000b520b70 00000080:02000400:0.0:1787781760.924475:0:6507:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787781760.936433:0:6507:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787781760.936446:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787781760.936489:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ac858935) 00000020:00000080:0.0:1787781760.936507:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787781761.027236:0:6507:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787781761.027310:0:6507:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1787781761.062217:0:6507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787781761.062491:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787781761.062498:0:6507:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787781761.062509:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15062e25 00000020:01000004:0.0:1787781761.062515:0:6507:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787781761.062520:0:6507:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787781761.062525:0:6507:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000b520b70 from MGS 00000020:01000004:0.0:1787781761.062529:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787781761.062630:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003364e3e6) 00000020:00000080:0.0:1787781761.062645:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787781761.062705:0:6507:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b520b70 from MGS, refs=2 00080000:01000000:0.0:1787781761.062711:0:6507:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787781761.062717:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15062e33 00000100:00100000:0.0:1787781761.062815:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787781761.063822:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787781761.063830:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787781761.067783:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787781761.067795:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787781761.068835:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781761.069017:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787781761.069023:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787781761.069992:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787781761.070001:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787781761.070786:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787781761.070797:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787781761.075948:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781761.075954:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781761.075956:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781761.077758:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781761.077765:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781761.077767:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781761.080280:0:6507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787781761.087647:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787781761.331347:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2613 MB/s 00000001:01000000:3.0:1787781761.581091:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3067 MB/s 00000001:01000000:2.0:1787781761.833342:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 523 MB/s 00000001:01000000:3.0:1787781762.083645:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 657 MB/s 00080000:10000000:3.0:1787781762.095827:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1787781762.115392:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787781762.118112:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787781762.118216:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787781762.118283:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787781762.118470:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787781762.118491:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787781762.119093:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787781762.119406:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787781762.119412:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:0.0:1787781762.120329:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781762.123695:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787781762.123709:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787781762.129042:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787781762.129573:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787781762.132029:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787781762.132050:0:6507:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.116@tcp' 00000020:01000004:2.0:1787781762.132052:0:6507:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787781762.132242:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.116@tcp (typ=mgc) 00000020:00000080:2.0:1787781762.132267:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.116@tcp (00000000bdada811) 00000020:00000080:2.0:1787781762.132285:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787781762.132436:0:6507:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000016c0fef2@MGC192.168.206.116@tcp: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787781762.134997:0:6507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.116@tcp-0 is initialized 00000040:01000000:2.0:1787781762.135008:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787781762.135457:0:6527:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787781762.136316:0:6528:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787781762.139792:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.116@tcp (uuid 2f49034a-383c-4a58-b5dc-1e0e9271edf7) 00000020:00000080:1.0:1787781762.139818:0:6507:0:(genops.c:1385:class_connect()) connect: client 2f49034a-383c-4a58-b5dc-1e0e9271edf7, cookie 0xc6d6745c15062e41 00000100:00080000:1.0:1787781762.139830:0:6507:0:(import.c:510:import_select_connection()) MGC192.168.206.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787781762.139836:0:6507:0:(import.c:624:import_select_connection()) MGC192.168.206.116@tcp: import 0000000016c0fef2 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787781762.139868:0:6507:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000add8b408 x1874624962887808/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787781762.140038:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624962887808:0@lo:250: 00000100:00100000:3.0:1787781762.140129:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787781762.141003:0:6507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS 00000020:01000004:1.0:1787781762.141031:0:6507:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787781762.141038:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787781762.141069:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f3cbb9e7) 00000020:00000080:1.0:1787781762.141084:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787781762.141553:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962887808 00000100:00100000:0.0:1787781762.141565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962887808 00000100:00100000:0.0:1787781762.141630:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781762.141637:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e129e588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3656:x1874624962887808:12345-0@lo:250: 00010000:00080000:0.0:1787781762.141661:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2f49034a-383c-4a58-b5dc-1e0e9271edf7@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1787781762.141684:0:6525:0:(genops.c:1385:class_connect()) connect: client 2f49034a-383c-4a58-b5dc-1e0e9271edf7, cookie 0xc6d6745c15062e4f 00000100:00080000:0.0:1787781762.141831:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000ca1deb3e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781762.148250:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e129e588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:3656:x1874624962887808:12345-0@lo:250: Request processed in 6599us (8109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.148269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781762.151948:0:3656:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787781762.151966:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.116@tcp: connect to target with instance 0 00000100:00080000:3.0:1787781762.151974:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787781762.151980:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787781762.151983:0:3656:0:(import.c:65:import_set_state_nolock()) 0000000016c0fef2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787781762.151987:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787781762.152000:0:3656:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787781762.152006:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624962887808:0@lo:250: 00000100:00100000:1.0:1787781762.171795:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787781762.172059:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787781762.172077:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787781762.173058:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787781762.173069:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787781762.174078:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787781762.174088:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787781762.175135:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781762.175403:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787781762.175409:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787781762.176394:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787781762.176405:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787781762.234579:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781762.235067:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787781762.235081:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787781762.235972:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787781762.235980:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787781762.240041:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781762.240262:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787781762.240268:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787781762.242670:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787781762.242683:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787781762.243291:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781762.243476:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787781762.243481:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787781762.244462:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787781762.244470:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787781762.259975:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781762.263512:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787781762.263522:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787781762.266066:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787781762.266089:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787781762.291003:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781762.291329:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787781762.291336:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787781762.292885:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787781762.292896:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787781762.294077:0:6507:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787781762.294088:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787781762.295100:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787781762.295127:0:6507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787781762.295132:0:6507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787781762.295245:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787781762.295277:0:6507:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.116@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787781762.295281:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787781762.295287:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787781762.295288:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781762.295289:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781762.295290:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781762.295291:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781762.295292:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781762.295294:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787781762.295294:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781762.295296:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781762.295297:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781762.295298:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781762.295300:0:6507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787781762.295302:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781762.295303:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787781762.295304:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781762.295304:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781762.295305:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781762.295306:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781762.295307:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781762.295308:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787781762.295308:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781762.295309:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781762.295310:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781762.295311:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781762.295345:0:6507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787781762.295360:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962887936:0@lo:253: 00000100:00100000:3.0:1787781762.295431:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.295481:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8626a2a going to sleep for 11 seconds 00000100:00100000:1.0:1787781762.295548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962887936 00000100:00100000:1.0:1787781762.295554:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962887936 00000100:00100000:1.0:1787781762.295596:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781762.295633:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009452cac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6507:x1874624962887936:12345-0@lo:253: 20000000:01000000:1.0:1787781762.295680:0:6526:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787781762.295683:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787781762.296330:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787781762.296704:0:6526:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787781762.297006:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781762.298424:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787781762.298722:0:6526:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787781762.298726:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787781762.298731:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787781762.298734:0:6526:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787781762.298743:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787781762.299003:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781762.299203:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787781762.299217:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787781762.299235:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787781762.299251:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787781762.299266:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787781762.299317:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787781762.299325:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787781762.299338:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787781762.299344:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787781762.299354:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787781762.299359:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787781762.299370:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787781762.299395:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787781762.299422:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787781762.299427:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787781762.299435:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781762.299521:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787781762.299530:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787781762.299544:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787781762.299557:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787781762.299570:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787781762.299578:0:6526:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787781762.299603:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787781762.300022:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787781762.300043:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787781762.300076:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787781762.300094:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787781762.300104:0:6526:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787781762.300130:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787781762.300138:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787781762.300151:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787781762.300180:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787781762.300253:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787781762.300277:0:6526:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787781762.300283:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787781762.300790:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787781762.301027:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787781762.301045:0:6526:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.116@tcp for mdt 20000000:01000000:1.0:1787781762.301047:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:1.0:1787781762.301060:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787781762.301065:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787781762.301075:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787781762.301079:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:1.0:1787781762.301089:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787781762.301095:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787781762.301116:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787781762.301131:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787781762.301156:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787781762.302007:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787781762.302010:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787781762.302079:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787781762.302082:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787781762.302592:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787781762.303059:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787781762.303084:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787781762.303098:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787781762.303106:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787781762.303108:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787781762.303434:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787781762.304059:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787781762.304080:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787781762.304122:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787781762.304135:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787781762.304137:0:6526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787781762.304141:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787781762.304143:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787781762.304147:0:6526:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787781762.304153:0:6526:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787781762.305049:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787781762.305240:0:6526:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787781762.317817:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787781762.317859:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787781762.317875:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787781762.318252:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781762.318279:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318296:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318306:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318312:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318318:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318325:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318332:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001241fe1a already unused, calling callback (000000003071bf1c) 00010000:00010000:2.0:1787781762.318336:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318344:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318356:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318364:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.318370:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001241fe1a/0xc6d6745c15062e56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787781762.318395:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787781762.334811:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009452cac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6507:x1874624962887936:12345-0@lo:253: Request processed in 39134us (39306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.334828:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781762.334999:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962887936:0@lo:253: 10000000:01000000:2.0:1787781762.335017:0:6507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787781762.335020:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787781762.335022:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787781762.335024:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781762.335025:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787781762.335026:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781762.335027:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781762.335028:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787781762.335030:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787781762.335031:0:6507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787781762.335032:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781762.335034:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787781762.335054:0:6507:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000b520b70 from lustre-MDT0000 10000000:01000000:2.0:1787781762.335087:0:6507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787781762.335090:0:6507:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787781762.335094:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff993d588099b8 10000000:01000000:2.0:1787781762.335098:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781762.335105:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993d588099b8 from 1 10000000:01000000:2.0:1787781762.335108:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787781762.335144:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.335154:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.335251:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.335269:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888064:0@lo:101: 00000100:00100000:2.0:1787781762.335364:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.335410:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8626a2a going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.335415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888064 00000100:00100000:0.0:1787781762.335421:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888064 00000100:00100000:0.0:1787781762.335454:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781762.335462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af0c0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6507:x1874624962888064:12345-0@lo:101: 00010000:00010000:0.0:1787781762.335480:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781762.335494:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062e5d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.335514:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.335524:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.335533:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab799ff2, rc 0) 00000100:00100000:0.0:1787781762.335580:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af0c0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:6507:x1874624962888064:12345-0@lo:101: Request processed in 118us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.335586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787781762.335675:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888064:0@lo:101: 00010000:00010000:2.0:1787781762.335687:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.335695:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.335751:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888192:0@lo:501: 00000100:00100000:2.0:1787781762.335776:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.335800:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8626a2a going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.335827:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888192 00000100:00100000:0.0:1787781762.335832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888192 00000100:00100000:0.0:1787781762.335868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781762.335875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f889b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:6507:x1874624962888192:12345-0@lo:501: 00000100:00100000:0.0:1787781762.335949:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f889b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:6507:x1874624962888192:12345-0@lo:501: Request processed in 75us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781762.335957:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781762.336012:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888192:0@lo:501: 10000000:01000000:2.0:1787781762.336037:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787781762.336056:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.336063:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781762.336071:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d47267800 10000000:01000000:2.0:1787781762.336075:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787781762.336078:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff993d47267800 10000000:01000000:2.0:1787781762.336081:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787781762.336083:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff993d47267800 from 1 10000000:01000000:2.0:1787781762.336086:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787781762.336099:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.336116:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.336124:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.336135:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888320:0@lo:101: 00000100:00100000:2.0:1787781762.336300:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.336362:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8626a2a going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.336397:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888320 00000100:00100000:0.0:1787781762.336402:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888320 00000100:00100000:0.0:1787781762.336459:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781762.336466:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fba10180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:6507:x1874624962888320:12345-0@lo:101: 00010000:00010000:0.0:1787781762.336473:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781762.336482:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7ab02ad/0xc6d6745c15062e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062e6b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.336507:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7ab02ad/0xc6d6745c15062e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062e6b expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.336515:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7ab02ad/0xc6d6745c15062e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062e6b expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.336523:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7ab02ad, rc 0) 00000100:00100000:0.0:1787781762.336560:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fba10180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:6507:x1874624962888320:12345-0@lo:101: Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.336566:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781762.336650:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b00c5465 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888320:0@lo:101: 00010000:00010000:3.0:1787781762.336662:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.336675:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781762.336688:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787781762.336699:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.336706:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000d9dcade8/0xc6d6745c15062e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781762.336712:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787781762.336716:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787781762.336720:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff993d47267800 10000000:01000000:3.0:1787781762.336723:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787781762.336726:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787781762.336728:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787781762.336744:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.336751:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.336757:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.336768:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888448:0@lo:101: 00000100:00100000:3.0:1787781762.336795:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.337014:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccfc6e60 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.337068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888448 00000100:00100000:2.0:1787781762.337072:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888448 00000100:00100000:2.0:1787781762.337094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781762.337100:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e21b33e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:6507:x1874624962888448:12345-0@lo:101: 00010000:00010000:2.0:1787781762.337107:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781762.337115:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062e79 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.337128:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.337136:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.337143:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ef4199a, rc 0) 00000100:00100000:2.0:1787781762.337198:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e21b33e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+8:6507:x1874624962888448:12345-0@lo:101: Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.337204:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781762.337269:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888448:0@lo:101: 00010000:00010000:3.0:1787781762.337279:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.337286:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.337336:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888576:0@lo:501: 00000100:00100000:3.0:1787781762.337359:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.337379:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccfc6e60 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.337423:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888576 00000100:00100000:2.0:1787781762.337432:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888576 00000100:00100000:2.0:1787781762.337449:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787781762.337454:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bf1f98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+8:6507:x1874624962888576:12345-0@lo:501: 00000100:00100000:2.0:1787781762.337559:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bf1f98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6507:x1874624962888576:12345-0@lo:501: Request processed in 105us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.337565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781762.337656:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888576:0@lo:501: 00000100:00100000:3.0:1787781762.337684:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888704:0@lo:503: 00000100:00100000:3.0:1787781762.337724:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.337741:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccfc6e60 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.337784:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888704 00000100:00100000:2.0:1787781762.337788:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888704 00000100:00100000:2.0:1787781762.337804:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781762.337810:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008168b7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6507:x1874624962888704:12345-0@lo:503: 00000100:00100000:2.0:1787781762.337889:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008168b7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6507:x1874624962888704:12345-0@lo:503: Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.337905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781762.338029:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962888704:0@lo:503: 00000100:00100000:3.0:1787781762.338370:0:6553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6553:1874624962888832:0@lo:502: 00000100:00100000:3.0:1787781762.338404:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.338425:0:6553:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d1a18d8 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.338469:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888832 00000100:00100000:2.0:1787781762.338473:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888832 00000100:00100000:2.0:1787781762.338491:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787781762.338496:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000344859cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6553:x1874624962888832:12345-0@lo:502: 00000100:00100000:2.0:1787781762.338575:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000344859cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6553:x1874624962888832:12345-0@lo:502: Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.338582:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781762.339197:0:6553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6553:1874624962888832:0@lo:502: 00000020:01000000:3.0:1787781762.339224:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781762.339234:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781762.339237:0:6553:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787781762.339241:0:6553:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787781762.339243:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781762.339328:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d3195fe8) 00000020:00000080:3.0:1787781762.339346:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787781762.339358:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787781762.339461:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787781762.339470:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15062e8e 00000020:00000080:3.0:1787781762.339734:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787781762.339739:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781762.339743:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781762.339744:0:6553:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787781762.339747:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781762.339751:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781762.339752:0:6553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787781762.339756:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781762.339762:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ef8ba86d) 00000020:00000080:3.0:1787781762.339772:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787781762.339776:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787781762.339778:0:6553:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787781762.339781:0:6553:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787781762.339786:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787781762.339831:0:6553:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b520b70 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787781762.339842:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b8f33716) 00000020:00000080:3.0:1787781762.339850:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787781762.340130:0:6553:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787781762.340137:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15062ea3 00000020:00000080:3.0:1787781762.340381:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787781762.340388:0:6553:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787781762.340393:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6d6745c15062eaa 00080000:01000000:3.0:1787781762.340398:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787781762.340401:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15062eb1 00080000:10000000:3.0:1787781762.341224:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787781762.341371:0:6553:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787781762.346080:0:6553:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787781762.472720:0:6553:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787781762.474257:0:6553:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787781762.479418:0:6553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787781762.479810:0:6553:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787781762.484519:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000dbfef152) 00000020:00000080:3.0:1787781762.484541:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787781762.484656:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787781762.484664:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15062ebf 00000020:00000080:3.0:1787781762.496080:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787781762.496957:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1787781762.523755:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787781762.527136:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787781762.533703:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787781762.538140:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787781762.544405:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787781762.548099:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6d6745c15062ec6 00000020:00000080:0.0:1787781762.548600:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787781762.548631:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781762.548637:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781762.548639:0:6553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787781762.548643:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781762.548646:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781762.548648:0:6553:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781762.548650:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781762.548652:0:6553:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787781762.548654:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781762.548656:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781762.548657:0:6553:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787781762.548659:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781762.548662:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781762.548664:0:6553:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787781762.548667:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787781762.548706:0:6553:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787781762.548765:0:6553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c21109d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6553:1874624962888960:0@lo:502: 00000100:00100000:0.0:1787781762.548834:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781762.548935:0:6553:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd3044d going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.551997:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962888960 00000100:00100000:0.0:1787781762.552010:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962888960 00000100:00100000:0.0:1787781762.552075:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781762.552091:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000685d2177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6553:x1874624962888960:12345-0@lo:502: 00000100:00100000:0.0:1787781762.552318:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000685d2177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6553:x1874624962888960:12345-0@lo:502: Request processed in 235us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.552326:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787781762.552418:0:6553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c21109d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6553:1874624962888960:0@lo:502: 00000020:01000000:1.0:1787781762.552451:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781762.552457:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781762.552460:0:6553:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787781762.552465:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787781762.552665:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787781762.552686:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787781762.552700:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.552710:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781762.552719:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d47267800 from 1 10000000:01000000:3.0:1787781762.552721:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787781762.552759:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.552768:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.552776:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.552793:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889088:0@lo:101: 00000100:00100000:3.0:1787781762.552828:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.552853:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.553336:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889088 00000100:00100000:0.0:1787781762.553342:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889088 00000100:00100000:0.0:1787781762.553378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781762.553384:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f983f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:6507:x1874624962889088:12345-0@lo:101: 00010000:00010000:0.0:1787781762.553395:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781762.553408:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062ecd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.553428:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.553438:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.553446:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7a386d6, rc 0) 00000100:00100000:0.0:1787781762.553486:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f983f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:6507:x1874624962889088:12345-0@lo:101: Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.553492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787781762.553593:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889088:0@lo:101: 00010000:00010000:3.0:1787781762.553627:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.553645:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.554175:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889216:0@lo:256: 00000100:00100000:3.0:1787781762.554224:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.554246:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.554507:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889216 00000100:00100000:0.0:1787781762.554512:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889216 00000100:00100000:0.0:1787781762.554545:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781762.554552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000804886b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:6507:x1874624962889216:12345-0@lo:256: 20000000:01000000:0.0:1787781762.554574:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787781762.554580:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787781762.554667:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000804886b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:6507:x1874624962889216:12345-0@lo:256: Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.554675:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787781762.554894:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889216:0@lo:256: 10000000:01000000:3.0:1787781762.555989:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787781762.556044:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.556056:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781762.558018:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d47267800 from 1 10000000:01000000:2.0:1787781762.558042:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781762.558078:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.558090:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.558100:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.558120:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889344:0@lo:101: 00000100:00100000:2.0:1787781762.558263:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.558305:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba58639b going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.558383:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889344 00000100:00100000:0.0:1787781762.558390:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889344 00000100:00100000:0.0:1787781762.558440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781762.558448:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000093f9278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:6507:x1874624962889344:12345-0@lo:101: 00010000:00010000:0.0:1787781762.558461:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781762.558474:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062edb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.558495:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062edb expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.558505:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062edb expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.558514:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e903746, rc 0) 00000100:00100000:0.0:1787781762.558552:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000093f9278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:6507:x1874624962889344:12345-0@lo:101: Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.558559:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787781762.558993:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889344:0@lo:101: 00010000:00010000:3.0:1787781762.559011:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.559020:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.559082:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889472:0@lo:501: 00000100:00100000:3.0:1787781762.559112:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.559141:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.559510:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889472 00000100:00100000:2.0:1787781762.559516:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889472 00000100:00100000:2.0:1787781762.559552:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787781762.559559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edac0549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:6507:x1874624962889472:12345-0@lo:501: 00000100:00100000:3.0:1787781762.559842:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889472:0@lo:501: 00000100:00100000:3.0:1787781762.559889:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889600:0@lo:503: 00000100:00100000:3.0:1787781762.559929:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.560074:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:1.0:1787781762.560096:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889600 00000100:00100000:1.0:1787781762.560103:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889600 00000100:00100000:1.0:1787781762.560129:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781762.560142:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b321764c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889600:12345-0@lo:503: 00000040:00080000:1.0:1787781762.560177:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787781762.560290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edac0549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889472:12345-0@lo:501: Request processed in 180us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.560298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781762.560781:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b321764c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:6507:x1874624962889600:12345-0@lo:503: Request processed in 638us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781762.560788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787781762.561003:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889600:0@lo:503: 00000040:00080000:1.0:1787781762.562104:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787781762.562279:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787781762.562303:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781762.562356:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.562368:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781762.562416:0:6507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787781762.562419:0:6507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d47267800 10000000:01000000:2.0:1787781762.562431:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d47267800 10000000:01000000:2.0:1787781762.562436:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781762.562442:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d47267800 from 1 10000000:01000000:2.0:1787781762.562445:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781762.562477:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.562485:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.562494:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.562512:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049ca60ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889728:0@lo:101: 00000100:00100000:2.0:1787781762.562569:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.562685:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b36d8361 going to sleep for 11 seconds 00000100:00100000:0.0:1787781762.562811:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889728 00000100:00100000:0.0:1787781762.562818:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889728 00000100:00100000:0.0:1787781762.562891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781762.562899:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098f3f4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:6507:x1874624962889728:12345-0@lo:101: 00010000:00010000:0.0:1787781762.562910:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781762.562925:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062ee9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.562945:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.562955:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.562963:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005dfeb4e9, rc 0) 00000100:00100000:0.0:1787781762.563010:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098f3f4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889728:12345-0@lo:101: Request processed in 112us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781762.563017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787781762.563090:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049ca60ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889728:0@lo:101: 00010000:00010000:3.0:1787781762.563102:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781762.563110:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781762.563161:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889856:0@lo:501: 00000100:00100000:3.0:1787781762.563198:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.563299:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.563380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889856 00000100:00100000:2.0:1787781762.563386:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889856 00000100:00100000:2.0:1787781762.563408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787781762.563414:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000363ed25c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889856:12345-0@lo:501: 00000100:00100000:2.0:1787781762.563528:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000363ed25c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889856:12345-0@lo:501: Request processed in 113us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.563535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787781762.563630:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889856:0@lo:501: 00000100:00100000:3.0:1787781762.563658:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889984:0@lo:503: 00000100:00100000:3.0:1787781762.563695:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.563710:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002e3fbd6 going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.563828:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962889984 00000100:00100000:2.0:1787781762.563832:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962889984 00000100:00100000:2.0:1787781762.563852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787781762.563856:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b4aa055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889984:12345-0@lo:503: 00000100:00100000:2.0:1787781762.563937:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b4aa055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962889984:12345-0@lo:503: Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.563953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787781762.564030:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962889984:0@lo:503: 00000100:00100000:3.0:1787781762.564404:0:6558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6558:1874624962890112:0@lo:502: 00000100:00100000:3.0:1787781762.564436:0:6558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781762.564467:0:6558:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6e6594c going to sleep for 11 seconds 00000100:00100000:2.0:1787781762.564513:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890112 00000100:00100000:2.0:1787781762.564517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890112 00000100:00100000:2.0:1787781762.564537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781762.564542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000510eee90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6558:x1874624962890112:12345-0@lo:502: 00000100:00100000:2.0:1787781762.564647:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000510eee90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6558:x1874624962890112:12345-0@lo:502: Request processed in 105us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.564654:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787781762.564775:0:6558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c424347 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6558:1874624962890112:0@lo:502: 00000020:01000004:3.0:1787781762.564825:0:6558:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787781762.564844:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b9a45912) 00000020:00000080:3.0:1787781762.564861:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787781762.564942:0:6558:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b520b70 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787781762.564947:0:6558:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000b520b70 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787781762.564949:0:6558:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000b520b70 4 00010000:00080000:3.0:1787781762.564976:0:6558:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000046d7f959@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:0.0:1787781762.567480:0:6558:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787781762.568591:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787781762.568681:0:6558:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787781762.568693:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6d6745c15062efe 00000100:00080000:0.0:1787781762.568703:0:6558:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787781762.568708:0:6558:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000046d7f959 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787781762.568741:0:6558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006fc05e9b x1874624962890240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787781762.568761:0:6558:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787781762.570157:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fc05e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624962890240:0@lo:38: 00000100:00100000:3.0:1787781762.570254:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781762.570427:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890240 00000100:00100000:1.0:1787781762.570436:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890240 00000100:00100000:1.0:1787781762.570514:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781762.570532:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c424347 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962890240:12345-0@lo:38: 00000100:00100000:1.0:1787781762.570683:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c424347 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962890240:12345-0@lo:38: Request processed in 150us (429us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787781762.570691:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781762.570863:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787781762.570869:0:3656:0:(import.c:65:import_set_state_nolock()) 0000000046d7f959 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787781762.570873:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787781762.570876:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fc05e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624962890240:0@lo:38: 00000100:00100000:2.0:1787781762.571313:0:6558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef78610c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6558:1874624962890368:0@lo:502: 00000100:00100000:2.0:1787781762.571364:0:6558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.571441:0:6558:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b36d8361 going to sleep for 11 seconds 00000100:00100000:3.0:1787781762.571482:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890368 00000100:00100000:3.0:1787781762.571486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890368 00000100:00100000:3.0:1787781762.571602:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781762.571918:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fdf8132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6558:x1874624962890368:12345-0@lo:502: 00000100:00100000:2.0:1787781762.572138:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fdf8132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6558:x1874624962890368:12345-0@lo:502: Request processed in 315us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.572147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787781762.572282:0:6558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef78610c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6558:1874624962890368:0@lo:502: 00000040:00080000:3.0:1787781762.572307:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787781762.572458:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787781762.572481:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781762.572593:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.572732:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787781762.572787:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787781762.572790:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787781762.572791:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781762.572793:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781762.572798:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781762.572800:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781762.572801:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787781762.572802:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787781762.572803:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781762.572804:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781762.572806:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781762.572807:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781762.572810:0:6507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787781762.572813:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787781762.572814:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787781762.572815:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781762.572816:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781762.572817:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781762.572818:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781762.572819:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787781762.572820:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787781762.572821:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781762.572822:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781762.572822:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781762.572823:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781762.572842:0:6507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787781762.572853:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef78610c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962890496:0@lo:253: 00000100:00100000:2.0:1787781762.572891:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.573008:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000947dc048 going to sleep for 11 seconds 00000100:00100000:3.0:1787781762.573338:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890496 00000100:00100000:3.0:1787781762.573346:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890496 00000100:00100000:3.0:1787781762.573387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781762.573395:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b6c0946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962890496:12345-0@lo:253: 20000000:01000000:3.0:1787781762.573422:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787781762.573435:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787781762.582059:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787781762.582081:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787781762.582287:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787781762.582292:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787781762.582312:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.582331:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.582358:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.582395:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.582408:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781762.582422:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000098be512 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962890624:0@lo:104: 00000100:00100000:0.0:1787781762.582485:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781762.582533:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 000000001685aab3 going to sleep for 11 seconds 00000100:00100000:3.0:1787781762.582748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890624 00000100:00100000:3.0:1787781762.582756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890624 00000100:00100000:3.0:1787781762.582801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781762.582808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3cf297e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962890624:12345-0@lo:104: 00010000:00010000:3.0:1787781762.582820:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781762.582864:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b6c0946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6507:x1874624962890496:12345-0@lo:253: Request processed in 9469us (9972us total) trans 0 rc 0/0 00010000:00010000:3.0:1787781762.582875:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781762.582880:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3cf297e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962890624:12345-0@lo:104: Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781762.582887:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781762.583242:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781762.583291:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000098be512 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962890624:0@lo:104: 00010000:00010000:0.0:1787781762.583311:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781762.583358:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef78610c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6507:1874624962890496:0@lo:253: 10000000:01000000:0.0:1787781762.583369:0:6507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787781762.583372:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787781762.583375:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787781762.583376:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781762.583377:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781762.583378:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781762.583379:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781762.583381:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787781762.583382:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787781762.583390:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781762.583392:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781762.583394:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781762.583395:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787781762.583406:0:6507:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787781762.585438:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781762.585450:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781762.585462:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e4345a80 already unused, calling callback (000000006055e1c4) 10000000:00010000:1.0:1787781762.585466:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781762.585476:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781762.585482:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781762.585488:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781762.585554:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781762.585573:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781762.585596:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781762.585604:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 00000000e4345a80/0xc6d6745c15062ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ed4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781762.585777:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781762.585779:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781762.585781:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781762.587112:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781762.587141:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962890752:0@lo:103: 00000100:00100000:2.0:1787781762.587230:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781762.592813:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890752 00000100:00100000:2.0:1787781762.592829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890752 00010000:00010000:2.0:1787781762.592874:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781762.592919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781762.592927:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049ca60ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3657:x1874624962890752:12345-0@lo:103: 00010000:00010000:2.0:1787781762.592941:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781762.592952:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.592963:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.592981:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b7a386d6/0xc6d6745c15062ed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062ecd expref: 12 pid: 6525 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.592999:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593007:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787781762.593022:0:6516:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010730873s 00010000:00010000:2.0:1787781762.593026:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593032:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593037:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593043:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593048:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f058f669 already unused, calling callback (000000003071bf1c) 00010000:00010000:2.0:1787781762.593051:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593058:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593080:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781762.593091:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781762.593162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049ca60ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:3657:x1874624962890752:12345-0@lo:103: Request processed in 236us (5932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781762.593170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781762.593240:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962890752:0@lo:103: 00010000:00010000:0.0:1787781762.595298:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.595333:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781762.595341:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f058f669/0xc6d6745c15062f05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787781762.596791:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787781762.596984:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787781762.597644:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787781762.598030:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787781762.598288:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787781762.598461:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787781762.602128:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787781762.602329:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787781762.602523:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787781762.603149:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787781762.603773:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787781762.604008:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787781762.610156:0:6507:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787781762.630317:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787781762.630402:0:6563:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787781762.630407:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787781762.636893:0:6564:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787781762.639321:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787781762.639476:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787781762.639939:0:6507:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787781762.639947:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787781762.640034:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781762.641464:0:6564:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781762.643298:0:6507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787781762.646056:0:6507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787781762.646146:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787781762.646475:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787781762.647339:0:6507:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1787781762.650500:0:6564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787781762.650588:0:6564:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787781762.650593:0:6564:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1787781762.651046:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787781762.655898:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787781762.656143:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787781762.656377:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787781762.656511:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787781762.656676:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787781762.656879:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787781762.659042:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787781762.659381:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787781762.659572:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787781762.661455:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787781762.661712:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787781762.662393:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787781762.662547:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787781762.664111:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787781762.664353:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787781762.665200:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787781762.665382:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787781762.665522:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787781762.665955:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787781762.666108:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787781762.666298:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787781762.666433:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787781762.666566:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787781762.667133:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787781762.667416:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787781762.667541:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787781762.668030:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787781762.669655:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787781762.670017:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787781762.670181:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787781762.670326:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787781762.670999:0:6507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787781762.674075:0:6507:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787781762.674212:0:6507:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffabe281c43988 00100000:10000000:2.0:1787781762.674221:0:6507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787781762.678997:0:6507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787781762.679015:0:6507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787781762.679033:0:6507:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787781762.679053:0:6507:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787781762.683712:0:6507:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787781762.684027:0:6507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787781763.141761:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781764.166713:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781765.190387:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781766.222249:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781767.237791:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781767.633820:0:6808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787781767.685757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787781767.685771:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787781767.685774:0:8:0:(import.c:65:import_set_state_nolock()) 0000000046d7f959 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787781767.685786:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000046d7f959 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787781767.685807:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000086944cb4 x1874624962891008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787781767.685843:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624962891008:0@lo:38: 00000100:00100000:1.0:1787781767.685914:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781767.685992:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891008 00000100:00100000:1.0:1787781767.685998:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891008 00000100:00100000:1.0:1787781767.686031:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781767.686037:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7d52d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624962891008:12345-0@lo:38: 00010000:00080000:1.0:1787781767.686063:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787781767.686109:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6d6745c15062f0c 00000004:00100000:1.0:1787781767.686157:0:6533:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787781767.686304:0:6533:0:(import.c:65:import_set_state_nolock()) 0000000079d1c216 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781767.686354:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7d52d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874624962891008:12345-0@lo:38: Request processed in 316us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781767.686362:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787781767.686403:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000086944cb4 x1874624962891008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787781767.686418:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787781767.686425:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787781767.686429:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787781767.686431:0:3656:0:(import.c:65:import_set_state_nolock()) 0000000046d7f959 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787781767.686436:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624962891008:0@lo:38: 00000100:00100000:3.0:1787781767.686679:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962890880:0@lo:400: 00000100:00100000:3.0:1787781767.686730:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781767.686917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962890880 00000100:00100000:1.0:1787781767.686922:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962890880 00000100:00100000:1.0:1787781767.686964:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787781767.686971:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d56a76a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:3659:x1874624962890880:12345-0@lo:400: 00000100:00100000:1.0:1787781767.687012:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d56a76a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:3659:x1874624962890880:12345-0@lo:400: Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781767.687018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787781767.687049:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962890880:0@lo:400: 00010000:00010000:0.0:1787781768.261777:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787781768.545914:0:6861:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781768.546258:0:6861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787781769.285903:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787781770.246036:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787781770.246045:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d47267800 from 3 10000000:01000000:2.0:1787781770.246050:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787781770.247011:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781770.247032:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781770.247043:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781770.247068:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962891136:0@lo:101: 00000100:00100000:2.0:1787781770.248566:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781770.248751:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eedf0799 going to sleep for 11 seconds 00000100:00100000:0.0:1787781770.248768:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891136 00000100:00100000:0.0:1787781770.248777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891136 00000100:00100000:0.0:1787781770.256514:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781770.256535:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a420ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:6528:x1874624962891136:12345-0@lo:101: 00010000:00010000:0.0:1787781770.256554:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781770.256572:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062f13 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781770.256630:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781770.256641:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781770.256650:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f058f669, rc 0) 00000100:00100000:0.0:1787781770.256722:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a420ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6528:x1874624962891136:12345-0@lo:101: Request processed in 198us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781770.256729:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781770.259884:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962891136:0@lo:101: 00010000:00010000:2.0:1787781770.259915:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781770.259927:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781770.260008:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962891264:0@lo:256: 00000100:00100000:2.0:1787781770.260070:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781770.260142:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eedf0799 going to sleep for 11 seconds 00000100:00100000:3.0:1787781770.260258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891264 00000100:00100000:3.0:1787781770.260264:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891264 00000100:00100000:3.0:1787781770.260320:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787781770.260329:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b667d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6528:x1874624962891264:12345-0@lo:256: 20000000:01000000:3.0:1787781770.260349:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787781770.260365:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787781770.260368:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787781770.260476:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b667d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:6528:x1874624962891264:12345-0@lo:256: Request processed in 148us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781770.260484:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781770.260703:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962891264:0@lo:256: 10000000:01000000:2.0:1787781770.260742:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787781770.260748:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781770.260757:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781770.309775:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787781771.311910:0:6962:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781771.312157:0:6962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787781771.334757:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781772.358248:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781772.806017:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962891392:0@lo:400: 00000100:00100000:0.0:1787781772.807189:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962891520:0@lo:400: 00000100:00100000:0.0:1787781772.807297:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781772.807549:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781772.807660:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891392 00000100:00100000:2.0:1787781772.807668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891392 00000100:00100000:2.0:1787781772.807727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781772.807735:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e254e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3660:x1874624962891392:12345-0@lo:400: 00000100:00100000:2.0:1787781772.807777:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e254e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3660:x1874624962891392:12345-0@lo:400: Request processed in 44us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781772.807784:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781772.807832:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962891392:0@lo:400: 00000100:00100000:1.0:1787781772.808595:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891520 00000100:00100000:1.0:1787781772.808603:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891520 00000100:00100000:1.0:1787781772.808684:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781772.808690:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000098be512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962891520:12345-0@lo:400: 00000100:00100000:1.0:1787781772.808757:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000098be512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962891520:12345-0@lo:400: Request processed in 67us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781772.808764:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787781772.810529:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007842e3f9 x1874624962891520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781772.810560:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962891520:0@lo:400: 00010000:00010000:3.0:1787781773.382947:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781774.406063:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781775.430069:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781776.454217:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781777.492886:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781777.932226:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013ef375a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962891648:0@lo:400: 00000100:00100000:1.0:1787781777.932317:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781777.932396:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da3a5d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962891776:0@lo:400: 00000100:00100000:1.0:1787781777.932426:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781777.932472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891648 00000100:00100000:1.0:1787781777.932480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891648 00000100:00100000:1.0:1787781777.932533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781777.932542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f8d68b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3658:x1874624962891648:12345-0@lo:400: 00000100:00100000:1.0:1787781777.932597:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f8d68b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3658:x1874624962891648:12345-0@lo:400: Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781777.932628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781777.932666:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891776 00000100:00100000:1.0:1787781777.932670:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891776 00000100:00100000:1.0:1787781777.932700:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781777.932707:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059514c79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962891776:12345-0@lo:400: 00000100:00100000:1.0:1787781777.932748:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059514c79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962891776:12345-0@lo:400: Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781777.932755:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781777.932798:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013ef375a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962891648:0@lo:400: 00010000:00080000:1.0:1787781777.932844:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000da3a5d51 x1874624962891776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781777.932858:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da3a5d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962891776:0@lo:400: 00010000:00010000:0.0:1787781778.502017:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781779.531427:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781780.549708:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787781781.344349:0:7460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787781781.344354:0:7460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787781781.344355:0:7460:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787781781.344491:0:7460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004b77ff8e 00000020:01000004:2.0:1787781781.344507:0:7460:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787781781.344517:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787781781.344529:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d5d9a84f) 00000020:00000080:2.0:1787781781.344547:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787781781.431500:0:7460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787781781.431590:0:7460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1787781781.472139:0:7460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787781781.472380:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787781781.472397:0:7460:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787781781.472407:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15062f28 00000020:01000004:2.0:1787781781.472413:0:7460:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787781781.472432:0:7460:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787781781.472434:0:7460:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787781781.472440:0:7460:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787781781.472465:0:7460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787781781.472469:0:7460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787781781.502812:0:7460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787781781.502855:0:7460:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.116@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787781781.502859:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787781781.502861:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787781781.502862:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781781.502864:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781781.502865:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781781.502866:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781781.502867:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781781.502868:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781781.502870:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781781.502871:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781781.502872:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781781.502875:0:7460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787781781.502878:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781781.502879:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787781781.502880:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781781.502881:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781781.502882:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781781.502883:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781781.502883:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781781.502884:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781781.502885:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781781.502886:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781781.502887:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781781.502913:0:7460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787781781.502928:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962891904:0@lo:253: 00000100:00100000:3.0:1787781781.502994:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.503105:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a6d6da7 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.505152:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962891904 00000100:00100000:2.0:1787781781.505257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962891904 00000100:00100000:2.0:1787781781.505324:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787781781.505333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046276dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:7460:x1874624962891904:12345-0@lo:253: 20000000:01000000:2.0:1787781781.505375:0:6525:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787781781.505380:0:6525:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787781781.505385:0:6525:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787781781.505388:0:6525:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787781781.505430:0:6525:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787781781.505918:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787781781.506058:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787781781.506073:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787781781.506106:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787781781.506125:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787781781.506141:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787781781.506218:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787781781.506226:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787781781.506237:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787781781.506242:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787781781.506252:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787781781.506257:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787781781.506268:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787781781.506281:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787781781.506400:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787781781.506411:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:2.0:1787781781.506427:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787781781.506436:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787781781.506448:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787781781.506453:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:2.0:1787781781.506464:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787781781.506469:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787781781.506915:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787781781.506939:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787781781.506953:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787781781.507052:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787781781.507064:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787781781.507079:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787781781.507112:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787781781.507130:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787781781.507136:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1787781781.507150:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787781781.507414:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787781781.507422:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1787781781.507449:0:6525:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787781781.507456:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787781781.508198:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787781781.508459:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787781781.508751:0:6525:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.116@tcp for mdt 20000000:01000000:2.0:1787781781.508754:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:2.0:1787781781.508776:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787781781.508782:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787781781.508795:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787781781.508799:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:2.0:1787781781.508813:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787781781.508834:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787781781.508848:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787781781.508862:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787781781.508904:0:6525:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787781781.508911:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787781781.510584:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787781781.510943:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787781781.510968:0:6525:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.116@tcp for mdt 20000000:01000000:2.0:1787781781.510970:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:2.0:1787781781.510988:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787781781.510995:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787781781.511009:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787781781.511014:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:2.0:1787781781.511028:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787781781.511034:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787781781.511047:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787781781.511063:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787781781.511094:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787781781.511097:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787781781.511101:0:6525:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787781781.511145:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787781781.511147:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781781.511480:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781781.511502:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781781.511518:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787781781.511791:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787781781.511812:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787781781.511828:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787781781.511837:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787781781.511839:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781781.512118:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781781.512137:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781781.512152:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787781781.512284:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787781781.512302:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787781781.512345:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787781781.512355:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787781781.512357:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781781.512749:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781781.512770:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781781.512785:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1787781781.513810:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787781781.513850:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787781781.513867:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1787781781.513882:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787781781.513884:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787781781.513889:0:6525:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787781781.513895:0:6525:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787781781.515123:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787781781.515263:0:6525:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787781781.527777:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781781.527805:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527824:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527831:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527838:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527844:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527887:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.527901:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.527915:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f71f8169 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892032:0@lo:104: 00000100:00100000:2.0:1787781781.527994:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781781.528118:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.528126:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 12 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.528135:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892160:0@lo:104: 00000100:00100000:2.0:1787781781.528160:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781781.528564:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.528573:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 12 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.528582:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892288:0@lo:104: 00000100:00100000:2.0:1787781781.528834:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.529172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892032 00000100:00100000:3.0:1787781781.529179:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892032 00000100:00100000:3.0:1787781781.529221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892160 00000100:00100000:3.0:1787781781.529234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892160 00000100:00100000:3.0:1787781781.529253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781781.529260:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042cd7fc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6525:x1874624962892032:12345-0@lo:104: 00010000:00010000:3.0:1787781781.529274:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.529334:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781781.529339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042cd7fc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6525:x1874624962892032:12345-0@lo:104: Request processed in 81us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.529346:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781781.529364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781781.529370:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b00c5465 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6525:x1874624962892160:12345-0@lo:104: 00010000:00010000:3.0:1787781781.529377:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.529411:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787781781.529415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b00c5465 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6525:x1874624962892160:12345-0@lo:104: Request processed in 46us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.529422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787781781.529485:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781781.529491:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529499:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0d88b7f already unused, calling callback (000000006055e1c4) 10000000:00010000:1.0:1787781781.529502:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529510:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781781.529517:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781781.529523:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781781.529558:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529565:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781781.529581:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529587:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 00000000f0d88b7f/0xc6d6745c15062ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ef0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529601:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781781.529604:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529660:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021b4f3a5 already unused, calling callback (000000006055e1c4) 10000000:00010000:1.0:1787781781.529663:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529670:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781781.529676:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781781.529682:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781781.529695:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529702:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781781.529714:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529720:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 0000000021b4f3a5/0xc6d6745c15062e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.529731:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781781.529732:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781781.529734:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781781.529746:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b301b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962892416:0@lo:103: 00000100:00100000:1.0:1787781781.529779:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781781.529832:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c17a506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962892544:0@lo:103: 00000100:00100000:1.0:1787781781.529854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781781.529900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892416 00000100:00100000:1.0:1787781781.529904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892416 00010000:00010000:1.0:1787781781.529932:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 13 pid: 6525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781781.529953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892544 00000100:00100000:1.0:1787781781.529956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892544 00010000:00010000:1.0:1787781781.529966:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781781.529979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781781.529984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ef375a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3660:x1874624962892416:12345-0@lo:103: 00010000:00010000:1.0:1787781781.529993:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781781.529997:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 14 pid: 6525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530005:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 14 pid: 6525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530020:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781781.530048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ef375a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3660:x1874624962892416:12345-0@lo:103: Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.530054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781781.530076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781781.530092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da3a5d51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3657:x1874624962892544:12345-0@lo:103: 00010000:00010000:1.0:1787781781.530100:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781781.530104:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 13 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530113:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 13 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530130:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781781.530141:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781781.530159:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da3a5d51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3657:x1874624962892544:12345-0@lo:103: Request processed in 78us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.530166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781781.530205:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c17a506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962892544:0@lo:103: 00000100:00100000:1.0:1787781781.530228:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b301b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962892416:0@lo:103: 00000100:00100000:2.0:1787781781.530293:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 000000008fa57669 going to sleep for 11 seconds 00010000:00010000:2.0:1787781781.530308:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005dfeb4e9/0xc6d6745c15062ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062ee9 expref: 12 pid: 6525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.530320:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f71f8169 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892032:0@lo:104: 00010000:00010000:2.0:1787781781.530328:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ef4199a/0xc6d6745c15062e80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062e79 expref: 11 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.530336:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892160:0@lo:104: 00000100:00100000:1.0:1787781781.530354:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892288 00000100:00100000:1.0:1787781781.530359:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892288 00000100:00100000:1.0:1787781781.530392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781781.530398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bdbfe92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6525:x1874624962892288:12345-0@lo:104: 00010000:00010000:1.0:1787781781.530406:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530449:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781781.530453:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bdbfe92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6525:x1874624962892288:12345-0@lo:104: Request processed in 56us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.530460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781781.530478:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874624962892288:0@lo:104: 00010000:00010000:1.0:1787781781.530479:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781781.530486:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530493:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001241fe1a already unused, calling callback (000000006055e1c4) 10000000:00010000:1.0:1787781781.530496:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530502:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.530504:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781781.530523:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781781.530537:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781781.530558:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530564:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781781.530574:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530579:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062e64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.530591:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781781.530593:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781781.530594:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781781.530601:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b301b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962892672:0@lo:103: 00000100:00100000:1.0:1787781781.531815:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.531871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892672 00000100:00100000:2.0:1787781781.531879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892672 00010000:00010000:2.0:1787781781.531925:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 11 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.531956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781781.531965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c17a506 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:3658:x1874624962892672:12345-0@lo:103: 00010000:00010000:2.0:1787781781.531977:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781781.531982:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 11 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.531992:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 11 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062e5d expref: 11 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532019:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532026:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532039:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532045:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532051:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532069:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532074:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a95a8f1 already unused, calling callback (000000003071bf1c) 00010000:00010000:2.0:1787781781.532077:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532094:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532118:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.532128:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781781.532135:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.532147:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.532153:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.532172:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c17a506 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:3658:x1874624962892672:12345-0@lo:103: Request processed in 208us (360us total) trans 0 rc 0/0 20000000:01000000:0.0:1787781781.532173:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787781781.532183:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781781.532870:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b301b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962892672:0@lo:103: 00000100:00100000:0.0:1787781781.534401:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046276dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:7460:x1874624962891904:12345-0@lo:253: Request processed in 29064us (31402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.534416:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787781781.534556:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962891904:0@lo:253: 10000000:01000000:3.0:1787781781.534570:0:7460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787781781.534573:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787781781.534575:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787781781.534576:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781781.534578:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787781781.534579:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781781.534580:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781781.534581:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781781.534582:0:7460:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787781781.534584:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781781.534597:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787781781.534709:0:7460:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004b77ff8e from lustre-MDT0001 10000000:01000000:3.0:1787781781.534741:0:7460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787781781.534743:0:7460:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787781781.534750:0:7460:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993d588099b8 local copy 10000000:01000000:3.0:1787781781.534753:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787781781.534783:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.534794:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.534804:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781781.534821:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962892800:0@lo:101: 00000100:00100000:3.0:1787781781.534858:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.534890:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030f4b919 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.535775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892800 00000100:00100000:1.0:1787781781.535787:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892800 00000100:00100000:1.0:1787781781.535835:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781781.535846:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074e79f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:7460:x1874624962892800:12345-0@lo:101: 00010000:00010000:1.0:1787781781.535877:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781781.535894:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cb013a2/0xc6d6745c15062f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062f36 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.535986:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cb013a2/0xc6d6745c15062f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062f36 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.535998:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cb013a2/0xc6d6745c15062f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f36 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.536006:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cb013a2, rc 0) 00000100:00100000:1.0:1787781781.536063:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074e79f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:7460:x1874624962892800:12345-0@lo:101: Request processed in 217us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.536070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787781781.536164:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962892800:0@lo:101: 00010000:00010000:3.0:1787781781.536208:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.536217:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781781.536345:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962892928:0@lo:501: 00000100:00100000:3.0:1787781781.536377:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.536450:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030f4b919 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.536495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962892928 00000100:00100000:1.0:1787781781.536500:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962892928 00000100:00100000:1.0:1787781781.536567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787781781.536575:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000770ab962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:7460:x1874624962892928:12345-0@lo:501: 00000100:00100000:1.0:1787781781.536776:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000770ab962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:7460:x1874624962892928:12345-0@lo:501: Request processed in 202us (400us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781781.536784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781781.536855:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962892928:0@lo:501: 10000000:01000000:2.0:1787781781.536870:0:7460:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787781781.536892:0:7460:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787781781.536897:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.536904:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.536910:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.536940:0:7460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787781781.536964:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d80a11800 10000000:01000000:2.0:1787781781.536969:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787781781.536974:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff993d588099b8 10000000:01000000:2.0:1787781781.536977:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787781781.536980:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff993d588099b8 from 1 10000000:01000000:2.0:1787781781.536983:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787781781.537001:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537008:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537015:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.537026:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893056:0@lo:101: 00000100:00100000:2.0:1787781781.537055:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.537163:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:3.0:1787781781.537202:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893056 00000100:00100000:3.0:1787781781.537207:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893056 00000100:00100000:3.0:1787781781.537235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787781781.537240:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e60fe47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:7460:x1874624962893056:12345-0@lo:101: 00010000:00010000:3.0:1787781781.537248:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781781.537260:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ca6a16a/0xc6d6745c15062f4b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062f44 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.537275:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ca6a16a/0xc6d6745c15062f4b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062f44 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.537283:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ca6a16a/0xc6d6745c15062f4b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f44 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.537290:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ca6a16a, rc 0) 00000100:00100000:3.0:1787781781.537327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e60fe47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:7460:x1874624962893056:12345-0@lo:101: Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.537333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787781781.537409:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893056:0@lo:101: 00010000:00010000:2.0:1787781781.537419:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537426:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537437:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787781781.537440:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787781781.537442:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537449:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c18f1116 already unused, calling callback (000000006055e1c4) 00010000:00010000:2.0:1787781781.537454:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781781.537458:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537465:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000002ef4199a/0xc6d6745c15062f44 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537466:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781781.537472:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781781.537473:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff993d80a11800 10000000:01000000:2.0:1787781781.537476:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787781781.537478:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787781781.537479:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff993d80a11800 from 1 10000000:01000000:2.0:1787781781.537481:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787781781.537492:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537493:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537499:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537499:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781781.537504:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.537513:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893184:0@lo:101: 00010000:00010000:0.0:1787781781.537514:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537519:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c15062f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c15062f3d expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.537531:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781781.537533:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781781.537534:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781781.537537:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.537560:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893184 00000100:00100000:2.0:1787781781.537633:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893184 00000100:00100000:2.0:1787781781.537664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781781.537670:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000798b610a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+11:7460:x1874624962893184:12345-0@lo:101: 00010000:00010000:2.0:1787781781.537677:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781781.537684:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062f52 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537697:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062f52 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537716:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a95a8f1/0xc6d6745c15062f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f52 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537723:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a95a8f1, rc 0) 00000100:00100000:2.0:1787781781.537747:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000798b610a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:7460:x1874624962893184:12345-0@lo:101: Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.537754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781781.537779:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.537790:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893184:0@lo:101: 00010000:00010000:2.0:1787781781.537799:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537805:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781781.537815:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787781781.537828:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537835:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000001b97c000/0xc6d6745c15062f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781781.537841:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787781781.537844:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781781.537848:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff993d80a11800 10000000:01000000:2.0:1787781781.537851:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787781781.537853:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787781781.537855:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787781781.537874:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537880:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537886:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.537897:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893440:0@lo:101: 00000100:00100000:2.0:1787781781.537921:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.537942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893440 00000100:00100000:2.0:1787781781.537946:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893440 00000100:00100000:2.0:1787781781.537963:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787781781.537968:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e3f3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:7460:x1874624962893440:12345-0@lo:101: 00010000:00010000:2.0:1787781781.537975:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781781.537981:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0d88b7f/0xc6d6745c15062f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062f60 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.537993:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0d88b7f/0xc6d6745c15062f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.538001:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0d88b7f/0xc6d6745c15062f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.538007:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0d88b7f, rc 0) 00000100:00100000:2.0:1787781781.538029:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e3f3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893440:12345-0@lo:101: Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.538035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787781781.538056:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.538076:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893440:0@lo:101: 00010000:00010000:2.0:1787781781.538099:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.538106:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.538171:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893568:0@lo:501: 00000100:00100000:2.0:1787781781.538196:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.538216:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893568 00000100:00100000:2.0:1787781781.538220:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893568 00000100:00100000:2.0:1787781781.538236:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787781781.538241:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009019e23f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893568:12345-0@lo:501: 00000100:00100000:2.0:1787781781.538322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009019e23f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893568:12345-0@lo:501: Request processed in 81us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.538329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787781781.538351:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.538362:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893568:0@lo:501: 00000100:00100000:2.0:1787781781.538387:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893696:0@lo:503: 00000100:00100000:2.0:1787781781.538426:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.538445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893696 00000100:00100000:2.0:1787781781.538449:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893696 00000100:00100000:2.0:1787781781.538465:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787781781.538470:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fafbe9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893696:12345-0@lo:503: 00000100:00100000:2.0:1787781781.538536:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fafbe9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893696:12345-0@lo:503: Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.538542:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787781781.538578:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.538589:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893696:0@lo:503: 00000040:00080000:2.0:1787781781.538844:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787781781.538903:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893824:0@lo:502: 00000100:00100000:2.0:1787781781.538939:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.538962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893824 00000100:00100000:2.0:1787781781.538966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893824 00000100:00100000:2.0:1787781781.538985:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787781781.538990:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bed48edd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893824:12345-0@lo:502: 00000100:00100000:2.0:1787781781.539052:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bed48edd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893824:12345-0@lo:502: Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.539059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787781781.539096:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.539108:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893824:0@lo:502: 00000040:00080000:2.0:1787781781.539285:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787781781.539308:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787781781.539320:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787781781.539334:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787781781.539346:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787781781.539357:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787781781.539368:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787781781.539380:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787781781.539392:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787781781.539404:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787781781.539418:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787781781.539430:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787781781.539440:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787781781.539450:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787781781.539461:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787781781.539482:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787781781.539494:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787781781.539505:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787781781.539515:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787781781.539526:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787781781.539537:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787781781.539548:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787781781.539560:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787781781.539581:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893952:0@lo:502: 00000100:00100000:2.0:1787781781.539646:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.539671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893952 00000100:00100000:2.0:1787781781.539674:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893952 00000100:00100000:2.0:1787781781.539693:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787781781.539697:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000300b6a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893952:12345-0@lo:502: 00000100:00100000:2.0:1787781781.539755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000300b6a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962893952:12345-0@lo:502: Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.539761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787781781.539789:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e2aca76 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.539800:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd9d74e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962893952:0@lo:502: 00000040:00080000:2.0:1787781781.539832:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787781781.539838:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:1.0:1787781781.540393:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c21109d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962893312:0@lo:103: 00000100:00100000:1.0:1787781781.540444:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787781781.540762:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781781.540783:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781781.540785:0:7472:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787781781.540794:0:7472:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787781781.540796:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781781.540811:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004b36f9f1) 00000020:00000080:1.0:1787781781.540830:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787781781.540836:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787781781.540924:0:7472:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787781781.540931:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15062f75 00000020:00000080:1.0:1787781781.541148:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787781781.541153:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781781.541157:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781781.541158:0:7472:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787781781.541161:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781781.541164:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781781.541165:0:7472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787781781.541169:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781781.541177:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000fe492357) 00000020:00000080:1.0:1787781781.541187:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787781781.541191:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787781781.541192:0:7472:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787781781.541195:0:7472:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787781781.541201:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787781781.541256:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004b77ff8e from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787781781.541269:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000079c3b08c) 00000020:00000080:1.0:1787781781.541278:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787781781.541346:0:7472:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787781781.541361:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15062f8a 00000020:00000080:1.0:1787781781.541446:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787781781.541452:0:7472:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787781781.541457:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc6d6745c15062f91 00080000:01000000:1.0:1787781781.541462:0:7472:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787781781.541466:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15062f98 00000100:00100000:3.0:1787781781.541752:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962893312 00000100:00100000:3.0:1787781781.541761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962893312 00000100:00100000:3.0:1787781781.541814:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781781.541821:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b301b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3659:x1874624962893312:12345-0@lo:103: 00010000:00010000:3.0:1787781781.541834:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781781.541850:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cb013a2/0xc6d6745c15062f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c15062f36 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.541863:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781781.541918:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b301b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:3659:x1874624962893312:12345-0@lo:103: Request processed in 98us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.541925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781781.542080:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c21109d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962893312:0@lo:103: 00080000:10000000:1.0:1787781781.542330:0:7472:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787781781.542461:0:7472:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787781781.573873:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781781.624122:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787781781.625055:0:7472:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787781781.631922:0:7472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787781781.633209:0:7472:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787781781.654970:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787781781.654984:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781781.654995:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781781.654997:0:7472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787781781.655020:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781781.655025:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781781.655027:0:7472:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787781781.655030:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787781781.655035:0:7472:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:00000080:2.0:1787781781.655061:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787781781.655076:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000454bdbc8) 00000020:00000080:2.0:1787781781.655106:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787781781.655112:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787781781.655213:0:7472:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787781781.655219:0:7472:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787781781.655226:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15062fa6 00010000:00080000:2.0:1787781781.655260:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000045ba438e@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787781781.656927:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787781781.663754:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787781781.663773:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787781781.663821:0:7472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787781781.663841:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15062fad 00000100:00080000:0.0:1787781781.663851:0:7472:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787781781.663857:0:7472:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000045ba438e using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787781781.663898:0:7472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9203cb8 x1874624962894080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787781781.663930:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787781781.664003:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962894208:0@lo:400: 00000100:00100000:0.0:1787781781.664065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.664163:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894208 00000100:00100000:0.0:1787781781.664170:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894208 00000100:00100000:0.0:1787781781.664209:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781781.664218:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e58acb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962894208:12345-0@lo:400: 00000100:00100000:0.0:1787781781.664283:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e58acb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962894208:12345-0@lo:400: Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.664291:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787781781.664341:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004771fb17 x1874624962894208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781781.664356:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962894208:0@lo:400: 00000020:01000000:0.0:1787781781.664418:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781781.664424:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664426:0:7472:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787781781.664430:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787781781.664433:0:7472:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787781781.664435:0:7472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787781781.664437:0:7472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787781781.664438:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787781781.664441:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664443:0:7472:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787781781.664447:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781781.664453:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664454:0:7472:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787781781.664459:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787781781.664495:0:7472:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787781781.664522:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781781.664527:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664528:0:7472:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787781781.664532:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781781.664534:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664536:0:7472:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781781.664539:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781781.664541:0:7472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787781781.664572:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781781.664575:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781781.664576:0:7472:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787781781.664580:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787781781.664845:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962894080:0@lo:38: 00000100:00100000:2.0:1787781781.664892:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787781781.664958:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787781781.664993:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787781781.665010:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.665021:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000001241fe1a/0xc6d6745c15062f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781781.665030:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d80a11800 from 1 10000000:01000000:2.0:1787781781.665033:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787781781.665062:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.665069:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.665099:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781781.665114:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894336:0@lo:101: 00000100:00100000:2.0:1787781781.665148:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.665171:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006451206 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.665237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894336 00000100:00100000:1.0:1787781781.665244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894336 00000100:00100000:0.0:1787781781.665253:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894080 00000100:00100000:0.0:1787781781.665260:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894080 00000100:00100000:1.0:1787781781.665287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781781.665294:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d4d8e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+12:7460:x1874624962894336:12345-0@lo:101: 00010000:00010000:1.0:1787781781.665305:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781781.665316:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062fb4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.665336:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787781781.665340:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.665346:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd9d74e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624962894080:12345-0@lo:38: 00010000:00010000:1.0:1787781781.665357:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.665366:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e45c71f3, rc 0) 00010000:00080000:0.0:1787781781.665370:0:6536:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787781781.665405:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15062fc2 00000100:00100000:1.0:1787781781.665408:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d4d8e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962894336:12345-0@lo:101: Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.665416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00100000:0.0:1787781781.665424:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787781781.665431:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787781781.665689:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894336:0@lo:101: 00010000:00010000:3.0:1787781781.665711:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.665720:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781781.670138:0:6536:0:(import.c:65:import_set_state_nolock()) 00000000b06ec11f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781781.670243:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd9d74e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624962894080:12345-0@lo:38: Request processed in 4897us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.670256:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781781.670308:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894464:0@lo:256: 00000100:00100000:3.0:1787781781.670364:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.670411:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000008172faa9 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.670450:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781781.670459:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787781781.670467:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787781781.670472:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787781781.670474:0:3656:0:(import.c:65:import_set_state_nolock()) 0000000045ba438e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787781781.670493:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962894080:0@lo:38: 00000100:00100000:3.0:1787781781.670688:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781781.670697:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f71f8169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962894592:0@lo:41: 00000100:00100000:3.0:1787781781.670729:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.670806:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894592 00000100:00100000:2.0:1787781781.670812:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894592 00000100:00100000:2.0:1787781781.670846:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781781.670853:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b89470d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962894592:12345-0@lo:41: 00000004:00000024:2.0:1787781781.670877:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787781781.670923:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b89470d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962894592:12345-0@lo:41: Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.670929:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781781.671022:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894464 00000100:00100000:0.0:1787781781.671027:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894464 00000100:00100000:3.0:1787781781.671048:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f71f8169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962894592:0@lo:41: 00000100:00100000:0.0:1787781781.671064:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781781.671073:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b8be2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962894464:12345-0@lo:256: 20000000:01000000:0.0:1787781781.671097:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787781781.672904:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787781781.672908:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787781781.673042:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b8be2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962894464:12345-0@lo:256: Request processed in 1970us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.673054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787781781.676044:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894464:0@lo:256: 10000000:01000000:3.0:1787781781.676766:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787781781.676786:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.676798:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781781.676806:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d80a11800 from 1 10000000:01000000:3.0:1787781781.676809:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781781.676840:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.676848:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.676873:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781781.676892:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894720:0@lo:101: 00000100:00100000:3.0:1787781781.676950:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.676995:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000008172faa9 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.677406:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894720 00000100:00100000:1.0:1787781781.677413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894720 00000100:00100000:1.0:1787781781.677468:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787781781.677476:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003513f06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:7460:x1874624962894720:12345-0@lo:101: 00010000:00010000:1.0:1787781781.677488:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781781.677500:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062fc9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.677530:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.677539:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781781.677547:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9103d67, rc 0) 00000100:00100000:1.0:1787781781.677598:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003513f06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962894720:12345-0@lo:101: Request processed in 123us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.677627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787781781.679289:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894720:0@lo:101: 00010000:00010000:3.0:1787781781.679312:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.679322:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781781.679425:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894848:0@lo:501: 00000100:00100000:3.0:1787781781.679488:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.679536:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000008172faa9 going to sleep for 11 seconds 00000100:00100000:0.0:1787781781.679538:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894848 00000100:00100000:0.0:1787781781.679545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894848 00000100:00100000:0.0:1787781781.679586:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781781.679594:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f56cbeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962894848:12345-0@lo:501: 00000100:00100000:0.0:1787781781.679742:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f56cbeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962894848:12345-0@lo:501: Request processed in 149us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.679749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787781781.679828:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894848:0@lo:501: 00000100:00100000:3.0:1787781781.679858:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894976:0@lo:503: 00000100:00100000:3.0:1787781781.679895:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.679933:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 000000008172faa9 going to sleep for 11 seconds 00000100:00100000:0.0:1787781781.679981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962894976 00000100:00100000:0.0:1787781781.679996:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962894976 00000100:00100000:0.0:1787781781.680029:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781781.680037:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012e5f6ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962894976:12345-0@lo:503: 00000040:00080000:0.0:1787781781.680070:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787781781.680120:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012e5f6ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962894976:12345-0@lo:503: Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.680126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787781781.680271:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962894976:0@lo:503: 00000040:00080000:3.0:1787781781.680507:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781781.680557:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787781781.680662:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781781.682739:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1787781781.683145:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787781781.683173:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781781.683185:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.683196:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781781.683269:0:7460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787781781.683284:0:7460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d80a11800 10000000:01000000:0.0:1787781781.683287:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d80a11800 10000000:01000000:0.0:1787781781.683291:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787781781.683297:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d80a11800 from 1 10000000:01000000:0.0:1787781781.683300:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787781781.683342:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.683351:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.683361:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.683382:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895104:0@lo:101: 00000100:00100000:0.0:1787781781.683453:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.683496:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e37df72a going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.683549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895104 00000100:00100000:2.0:1787781781.683556:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895104 00000100:00100000:2.0:1787781781.683600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787781781.683633:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004afe28a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:7460:x1874624962895104:12345-0@lo:101: 00010000:00010000:2.0:1787781781.683647:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781781.683662:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000473f494a/0xc6d6745c15062fde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15062fd7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.683684:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000473f494a/0xc6d6745c15062fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.683695:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000473f494a/0xc6d6745c15062fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781781.683716:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000473f494a, rc 0) 00000100:00100000:2.0:1787781781.683762:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004afe28a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895104:12345-0@lo:101: Request processed in 155us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.683768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781781.686076:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895104:0@lo:101: 00010000:00010000:0.0:1787781781.686118:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.686129:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.686375:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895232:0@lo:501: 00000100:00100000:0.0:1787781781.686431:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.686473:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e37df72a going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.686667:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895232 00000100:00100000:1.0:1787781781.686675:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895232 00000100:00100000:1.0:1787781781.686721:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787781781.686730:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b16e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895232:12345-0@lo:501: 00000100:00100000:1.0:1787781781.686843:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b16e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895232:12345-0@lo:501: Request processed in 115us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.686851:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781781.686889:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895232:0@lo:501: 00000100:00100000:0.0:1787781781.686938:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895360:0@lo:503: 00000100:00100000:0.0:1787781781.688253:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.688292:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e37df72a going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.688442:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895360 00000100:00100000:2.0:1787781781.688450:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895360 00000100:00100000:2.0:1787781781.688495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787781781.688502:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034d987d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895360:12345-0@lo:503: 00000100:00100000:2.0:1787781781.688651:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034d987d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895360:12345-0@lo:503: Request processed in 148us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.688659:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781781.688721:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895360:0@lo:503: 00000040:00080000:1.0:1787781781.689048:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787781781.689133:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895488:0@lo:502: 00000100:00100000:1.0:1787781781.689173:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781781.689206:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e61d6625 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.689260:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895488 00000100:00100000:2.0:1787781781.689264:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895488 00000100:00100000:2.0:1787781781.689301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787781781.689307:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9bf5864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895488:12345-0@lo:502: 00000100:00100000:2.0:1787781781.689392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9bf5864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895488:12345-0@lo:502: Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.689400:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787781781.689480:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895488:0@lo:502: 00000040:00080000:1.0:1787781781.689683:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787781781.689709:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787781781.689724:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787781781.689739:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787781781.689752:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787781781.689776:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787781781.689791:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787781781.689805:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787781781.689818:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787781781.689830:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787781781.689842:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787781781.689855:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787781781.689868:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787781781.689882:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787781781.689895:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787781781.689908:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787781781.689921:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787781781.689935:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787781781.689948:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787781781.689961:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787781781.689973:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787781781.689986:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787781781.689999:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787781781.690013:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787781781.690026:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787781781.690037:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787781781.690048:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787781781.690061:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1787781781.690099:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895616:0@lo:502: 00000100:00100000:1.0:1787781781.690137:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781781.690166:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e61d6625 going to sleep for 11 seconds 00000100:00100000:3.0:1787781781.690244:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895616 00000100:00100000:3.0:1787781781.690255:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895616 00000100:00100000:3.0:1787781781.690295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787781781.690302:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eaae5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895616:12345-0@lo:502: 00000100:00100000:3.0:1787781781.690390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eaae5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895616:12345-0@lo:502: Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.690397:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787781781.690478:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895616:0@lo:502: 00000040:00080000:1.0:1787781781.690519:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787781781.690527:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787781781.691056:0:7478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787781781.691096:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004984f9d3) 00000020:00000080:1.0:1787781781.691121:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787781781.691207:0:7478:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004b77ff8e from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787781781.691211:0:7478:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004b77ff8e from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787781781.691214:0:7478:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004b77ff8e 3 00010000:00080000:1.0:1787781781.691242:0:7478:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d01b54fb@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787781781.692901:0:7478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1787781781.693392:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787781781.693431:0:7478:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787781781.693442:0:7478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc6d6745c15062fec 00000100:00080000:1.0:1787781781.693452:0:7478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787781781.693456:0:7478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000d01b54fb using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787781781.693487:0:7478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000add8b408 x1874624962895744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787781781.693547:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624962895744:0@lo:38: 00000100:00100000:2.0:1787781781.693636:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.693726:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895744 00000100:00100000:3.0:1787781781.693733:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895744 00000100:00100000:3.0:1787781781.693765:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781781.693772:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef78610c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962895744:12345-0@lo:38: 00010000:00080000:3.0:1787781781.693792:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1787781781.693819:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc6d6745c15062ff3 00000004:00100000:3.0:1787781781.693833:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787781781.693858:0:6531:0:(import.c:65:import_set_state_nolock()) 00000000bffca77b : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787781781.693931:0:7478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787781781.695998:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1787781781.696265:0:7479:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1787781781.696380:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef78610c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874624962895744:12345-0@lo:38: Request processed in 2604us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.696392:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1787781781.696419:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787781781.696450:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787781781.696501:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781781.696511:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 0000000002c48476/0xc6d6745c15062fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787781781.696556:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787781781.696558:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787781781.696559:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781781.696561:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781781.696565:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781781.696566:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781781.696567:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781781.696568:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781781.696569:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781781.696570:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781781.696572:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787781781.696574:0:7460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1787781781.696576:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781781.696578:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787781781.696579:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781781.696580:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781781.696581:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781781.696581:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781781.696582:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787781781.696583:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781781.696584:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781781.696585:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781781.696586:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787781781.696628:0:7460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787781781.696645:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895872:0@lo:253: 00000100:00100000:3.0:1787781781.696696:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.696724:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085bff440 going to sleep for 11 seconds 00000100:00100000:1.0:1787781781.696780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962895872 00000100:00100000:1.0:1787781781.696786:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962895872 00000100:00100000:1.0:1787781781.696827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781781.696834:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e8de869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895872:12345-0@lo:253: 20000000:01000000:1.0:1787781781.696857:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787781781.696870:0:6525:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787781781.699803:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000add8b408 x1874624962895744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781781.699823:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787781781.699835:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787781781.699846:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787781781.699861:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787781781.699866:0:3656:0:(import.c:65:import_set_state_nolock()) 00000000d01b54fb lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787781781.699874:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624962895744:0@lo:38: 00000001:00100000:1.0:1787781781.700942:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787781781.701056:0:6525:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787781781.701068:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787781781.701322:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e8de869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7460:x1874624962895872:12345-0@lo:253: Request processed in 4486us (4623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.701334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781781.701397:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe5140 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7460:1874624962895872:0@lo:253: 10000000:01000000:1.0:1787781781.701420:0:7460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787781781.701423:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787781781.701425:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787781781.701426:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787781781.701428:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787781781.701429:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787781781.701430:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787781781.701431:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787781781.701433:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787781781.701434:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787781781.701436:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787781781.701437:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787781781.701452:0:7460:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787781781.703127:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787781781.703136:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787781781.703157:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703175:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703182:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703188:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703228:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703244:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 14 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.703256:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962896000:0@lo:104: 00000100:00100000:0.0:1787781781.703309:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781781.703358:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703366:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.703383:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962896128:0@lo:104: 00000100:00100000:0.0:1787781781.703407:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.703423:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 0000000043aaabe6 going to sleep for 11 seconds 00000100:00100000:0.0:1787781781.703446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896000 00000100:00100000:0.0:1787781781.703453:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896000 00000100:00100000:0.0:1787781781.703488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896128 00000100:00100000:0.0:1787781781.703491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896128 00000100:00100000:0.0:1787781781.703504:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781781.703510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec177ea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962896000:12345-0@lo:104: 00010000:00010000:0.0:1787781781.703521:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.703563:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781781.703568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec177ea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962896000:12345-0@lo:104: Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.703574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781781.703589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781781.703594:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709bffad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962896128:12345-0@lo:104: 00010000:00010000:0.0:1787781781.703600:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704117:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781781.704123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709bffad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962896128:12345-0@lo:104: Request processed in 528us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.704129:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781781.704167:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962896000:0@lo:104: 00000100:00100000:0.0:1787781781.704176:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962896128:0@lo:104: 00010000:00010000:0.0:1787781781.704204:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704223:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781781.704228:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704235:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058998bcd already unused, calling callback (000000006055e1c4) 10000000:00010000:0.0:1787781781.704237:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704244:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781781.704250:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781781.704256:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781781.704286:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704293:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781781.704311:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704318:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 0000000058998bcd/0xc6d6745c15062fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fbb expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704329:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781781.704331:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704348:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d50c664 already unused, calling callback (000000006055e1c4) 10000000:00010000:0.0:1787781781.704349:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704355:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781781.704360:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781781.704364:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781781.704377:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704383:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781781.704396:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704402:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 000000003d50c664/0xc6d6745c15062f13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f1a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.704417:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781781.704420:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781781.704422:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781781.704428:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781781.704441:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962896256:0@lo:103: 00000100:00100000:0.0:1787781781.704470:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.704505:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962896384:0@lo:103: 00000100:00100000:0.0:1787781781.704538:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.704577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896256 00000100:00100000:0.0:1787781781.704583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896256 00010000:00010000:0.0:1787781781.704602:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 15 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.706186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896384 00000100:00100000:0.0:1787781781.706197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896384 00010000:00010000:0.0:1787781781.706222:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 16 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.706241:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781781.706247:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c086e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3658:x1874624962896256:12345-0@lo:103: 00010000:00010000:0.0:1787781781.706274:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781781.706280:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 16 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706290:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 16 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706305:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e45c71f3/0xc6d6745c15062fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062fb4 expref: 16 pid: 6523 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706318:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781781.706419:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c086e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3658:x1874624962896256:12345-0@lo:103: Request processed in 172us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.706427:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781781.706444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781781.706450:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084af9231 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3659:x1874624962896384:12345-0@lo:103: 00010000:00010000:0.0:1787781781.706457:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781781.706470:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706477:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706486:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f058f669/0xc6d6745c15062f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062f13 expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706496:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706504:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787781781.706518:0:6516:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010730873s 00010000:00010000:0.0:1787781781.706521:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706527:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706532:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706537:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706543:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab799ff2 already unused, calling callback (000000003071bf1c) 00010000:00010000:0.0:1787781781.706546:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706553:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706573:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706582:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781781.706625:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084af9231 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3659:x1874624962896384:12345-0@lo:103: Request processed in 176us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781781.706631:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787781781.706680:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706689:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781781.706694:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab799ff2/0xc6d6745c15062ffa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781781.706729:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962896384:0@lo:103: 00080000:10000000:1.0:1787781781.711525:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.711777:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787781781.711971:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.712172:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:3.0:1787781781.712813:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962896256:0@lo:103: 00080000:10000000:1.0:1787781781.713304:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.713499:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787781781.717519:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.718202:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787781781.718401:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.719784:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787781781.720207:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787781781.720438:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1787781781.722265:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787781781.722525:0:7484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787781781.722573:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049ca60ac pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7484:1874624962896512:0@lo:700: 00000040:01000000:0.0:1787781781.722731:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787781781.722892:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.722946:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ae00fe going to sleep for 11 seconds 00000100:00100000:0.0:1787781781.723076:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896512 00000100:00100000:0.0:1787781781.723091:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896512 00000100:00100000:0.0:1787781781.723145:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781781.723152:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f71f8169 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7484:x1874624962896512:12345-0@lo:700: 00000020:00080000:1.0:1787781781.723316:0:7483:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787781781.723321:0:7483:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787781781.723479:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962896640:0@lo:1000: 00000100:00100000:1.0:1787781781.723517:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781781.723543:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb2ff11 going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.723819:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896640 00000100:00100000:2.0:1787781781.723824:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896640 00000100:00100000:2.0:1787781781.723854:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787781781.723860:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e065fccc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962896640:12345-0@lo:1000: 00000100:00100000:2.0:1787781781.723928:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e065fccc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962896640:12345-0@lo:1000: Request processed in 68us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.723936:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:1.0:1787781781.724445:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787781781.724566:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787781781.724768:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962896640:0@lo:1000: 00000040:01000000:0.0:1787781781.724797:0:7485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787781781.724825:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962896768:0@lo:700: 00000100:00100000:0.0:1787781781.724859:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.724883:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e37df72a going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.724968:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896768 00000100:00100000:2.0:1787781781.724973:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896768 00000100:00100000:2.0:1787781781.725095:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781781.725102:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c086e3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962896768:12345-0@lo:700: 00000100:00100000:2.0:1787781781.725145:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c086e3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962896768:12345-0@lo:700: Request processed in 44us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.725152:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781781.725271:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962896768:0@lo:700: 00000100:00100000:0.0:1787781781.725307:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7485:1874624962896896:0@lo:900: 00000100:00100000:0.0:1787781781.725335:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781781.725405:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e37df72a going to sleep for 11 seconds 00000004:00000080:1.0:1787781781.725874:0:7460:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787781781.725884:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787781781.726107:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781781.727161:0:7460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787781781.727706:0:7460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787781781.727735:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787781781.729584:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787781781.729818:0:7460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787781781.730721:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787781781.730859:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:3.0:1787781781.731127:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962896896 00000100:00100000:3.0:1787781781.731136:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962896896 00000100:00100000:3.0:1787781781.731181:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781781.731189:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e03fa066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7485:x1874624962896896:12345-0@lo:900: 00000100:00100000:3.0:1787781781.731280:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e03fa066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7485:x1874624962896896:12345-0@lo:900: Request processed in 93us (5945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.731288:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1787781781.731382:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787781781.731534:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787781781.731864:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787781781.732144:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787781781.732338:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787781781.732491:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787781781.732776:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787781781.732965:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787781781.733316:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787781781.733445:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00010000:00080000:2.0:1787781781.733709:0:7485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004771fb17 x1874624962896896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787781797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781781.733726:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7485:1874624962896896:0@lo:900: 00000100:00100000:2.0:1787781781.733837:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897024:0@lo:1000: 00000100:00100000:2.0:1787781781.733909:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.733951:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a41e1b50 going to sleep for 11 seconds 00000100:00100000:3.0:1787781781.734167:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897024 00000100:00100000:3.0:1787781781.734174:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897024 00000100:00100000:3.0:1787781781.734223:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787781781.734236:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0363b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897024:12345-0@lo:1000: 00000100:00100000:3.0:1787781781.734307:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0363b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897024:12345-0@lo:1000: Request processed in 72us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781781.734315:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:1.0:1787781781.734382:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787781781.734566:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:2.0:1787781781.734744:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d10b768 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897024:0@lo:1000: 00000004:00080000:2.0:1787781781.734796:0:7485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d5f19c4a with version 0 00000020:00100000:2.0:1787781781.734813:0:7485:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787781781.734818:0:7485:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f7c430da x1874624962897280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787781781.734831:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7c430da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897280:0@lo:1000: 00000100:00100000:2.0:1787781781.734861:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.734888:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079e02cce going to sleep for 11 seconds 00100000:10000000:1.0:1787781781.735132:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787781781.735290:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787781781.735602:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:3.0:1787781781.735757:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897280 00000100:00100000:3.0:1787781781.735764:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897280 00000100:00100000:3.0:1787781781.735802:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781781.735809:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f9ad0e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897280:12345-0@lo:1000: 00100000:10000000:1.0:1787781781.736158:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787781781.736313:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787781781.736461:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787781781.736594:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787781781.736778:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787781781.736932:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787781781.737077:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787781781.737226:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787781781.737368:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 40000000:02000000:0.0:1787781781.737875:0:6539:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1787781781.740851:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787781781.741453:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787781781.742768:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787781781.742973:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787781781.745829:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787781781.746000:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787781781.746215:0:7460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787781781.752916:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1787781781.753262:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f71f8169 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7484:x1874624962896512:12345-0@lo:700: Request processed in 30107us (30368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781781.753279:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787781781.753372:0:7484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000049ca60ac x1874624962896512/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787781797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781781.753387:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049ca60ac pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7484:1874624962896512:0@lo:700: 40000000:02000000:3.0:1787781781.753400:0:7484:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1787781781.759790:0:7460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787781781.759830:0:7460:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffabe281c43988 00100000:10000000:2.0:1787781781.759839:0:7460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1787781781.760030:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f9ad0e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897280:12345-0@lo:1000: Request processed in 24218us (25165us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787781781.760043:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1787781781.760453:0:7485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787781781.760459:0:7485:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787781781.760475:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7c430da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897280:0@lo:1000: 00000100:00100000:2.0:1787781781.760567:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7c430da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897408:0@lo:1000: 00000100:00100000:2.0:1787781781.761340:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781781.761386:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897408 00000100:00100000:2.0:1787781781.761394:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897408 00000100:00100000:2.0:1787781781.761436:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781781.761444:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e9c45b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897408:12345-0@lo:1000: 00000100:00100000:2.0:1787781781.761518:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e9c45b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7485:x1874624962897408:12345-0@lo:1000: Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781781.761525:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781781.761568:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ceca039c going to sleep for 11 seconds 00000100:00100000:2.0:1787781781.761598:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7c430da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1874624962897408:0@lo:1000: 00000040:00080000:2.0:1787781781.761652:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:1.0:1787781781.762324:0:7460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787781781.762354:0:7460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787781781.762370:0:7460:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787781781.762388:0:7460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:2.0:1787781781.765283:0:7485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d5f19c4a with version 1 00000004:00080000:3.0:1787781781.767238:0:7475:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e9232824 version 1 rpc_version 1 00000020:00100000:3.0:1787781781.768014:0:7475:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787781781.768025:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e4456a3e x1874624962897664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787781781.768047:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4456a3e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7475:1874624962897664:0@lo:1000: 00000100:00100000:3.0:1787781781.768123:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781781.768171:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a6d6da7 going to sleep for 11 seconds 00000040:00080000:2.0:1787781781.770925:0:7485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787781781.771078:0:7485:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787781781.771137:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897664 00000100:00100000:2.0:1787781781.771147:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897664 00000100:00100000:2.0:1787781781.771778:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787781781.771791:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a6290df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874624962897664:12345-0@lo:1000: 00000020:00000004:2.0:1787781781.782099:0:7460:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787781781.783600:0:7460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:2.0:1787781781.785447:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787781781.785576:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a6290df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874624962897664:12345-0@lo:1000: Request processed in 13786us (17450us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787781781.785588:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787781781.787144:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787781781.787153:0:7475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787781781.787172:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4456a3e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7475:1874624962897664:0@lo:1000: 00000040:00080000:2.0:1787781781.809694:0:7484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781781.822430:0:7484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787781781.822505:0:7484:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787781781.822518:0:7484:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787781782.598846:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781783.622719:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781784.645904:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781785.670012:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781786.437127:0:7730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787781786.694522:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781787.142015:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c49a1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962897792:0@lo:41: 00000100:00100000:0.0:1787781787.142095:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781787.142351:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962897920:0@lo:400: 00000100:00100000:0.0:1787781787.142382:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781787.142407:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781787.142412:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962898048:0@lo:400: 00000100:00100000:0.0:1787781787.142436:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781787.142478:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898048 00000100:00100000:0.0:1787781787.142485:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898048 00000100:00100000:0.0:1787781787.142525:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781787.142532:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1dde79e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962898048:12345-0@lo:400: 00000100:00100000:0.0:1787781787.142578:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1dde79e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962898048:12345-0@lo:400: Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781787.142585:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781787.142635:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6b6c2f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962898176:0@lo:400: 00000100:00100000:0.0:1787781787.142658:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787781787.142713:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007842e3f9 x1874624962898048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781787.142727:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007842e3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962898048:0@lo:400: 00000100:00100000:1.0:1787781787.142927:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897920 00000100:00100000:1.0:1787781787.142932:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897920 00000100:00100000:1.0:1787781787.142960:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787781787.142965:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000778fdb6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3657:x1874624962897920:12345-0@lo:400: 00000100:00100000:1.0:1787781787.143009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000778fdb6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3657:x1874624962897920:12345-0@lo:400: Request processed in 44us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781787.143016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787781787.143329:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086944cb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962897920:0@lo:400: 00000100:00100000:3.0:1787781787.144347:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962897792 00000100:00100000:3.0:1787781787.144355:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962897792 00000100:00100000:3.0:1787781787.144404:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781787.144411:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017883ace pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962897792:12345-0@lo:41: 00000004:00000024:3.0:1787781787.144449:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787781787.146660:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017883ace pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962897792:12345-0@lo:41: Request processed in 2240us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781787.146677:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781787.146740:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898176 00000100:00100000:3.0:1787781787.146749:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898176 00000100:00100000:3.0:1787781787.146798:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781787.146805:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c471ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962898176:12345-0@lo:400: 00000100:00100000:3.0:1787781787.146879:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c471ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962898176:12345-0@lo:400: Request processed in 74us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781787.146886:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787781787.146925:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a6b6c2f7 x1874624962898176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781787.146939:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6b6c2f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962898176:0@lo:400: 00000100:00100000:0.0:1787781787.152402:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c49a1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962897792:0@lo:41: 00000020:00000004:2.0:1787781787.411318:0:7782:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787781787.411521:0:7782:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787781787.718729:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781788.742069:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781789.765982:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787781790.213261:0:7884:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781790.213481:0:7884:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787781790.213747:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787781790.213751:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d80a11800 from 4 10000000:01000000:0.0:1787781790.213755:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787781790.213794:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.213805:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.213816:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.213839:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c49a1e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898304:0@lo:101: 00000100:00100000:0.0:1787781790.213903:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.213951:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d1a7a06 going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.214290:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898304 00000100:00100000:2.0:1787781790.214299:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898304 00000100:00100000:2.0:1787781790.214359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787781790.214367:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012b35bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:6528:x1874624962898304:12345-0@lo:101: 00010000:00010000:2.0:1787781790.214381:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781790.214394:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f2884f7/0xc6d6745c15063008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063001 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781790.214416:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f2884f7/0xc6d6745c15063008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063001 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781790.214444:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f2884f7/0xc6d6745c15063008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063001 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781790.214451:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f2884f7, rc 0) 00000100:00100000:2.0:1787781790.214501:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012b35bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:6528:x1874624962898304:12345-0@lo:101: Request processed in 135us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.214508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781790.214649:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c49a1e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898304:0@lo:101: 00010000:00010000:3.0:1787781790.214664:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781790.214673:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781790.214742:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898432:0@lo:256: 00000100:00100000:3.0:1787781790.214776:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781790.214795:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000009308c20d going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.214917:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898432 00000100:00100000:0.0:1787781790.214923:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898432 00000100:00100000:0.0:1787781790.214950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787781790.214956:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ddba954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:6528:x1874624962898432:12345-0@lo:256: 20000000:01000000:0.0:1787781790.214970:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787781790.214995:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787781790.215011:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787781790.215095:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ddba954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:6528:x1874624962898432:12345-0@lo:256: Request processed in 138us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.215102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787781790.215227:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898432:0@lo:256: 10000000:01000000:3.0:1787781790.215273:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787781790.215280:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781790.215288:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000f058f669/0xc6d6745c15063001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781790.215297:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787781790.215299:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d47267800 from 21 10000000:01000000:3.0:1787781790.215302:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781790.215320:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781790.215327:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781790.215334:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781790.215347:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898560:0@lo:101: 00000100:00100000:3.0:1787781790.215373:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781790.215404:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000009308c20d going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.215448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898560 00000100:00100000:0.0:1787781790.215452:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898560 00000100:00100000:0.0:1787781790.215484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781790.215490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084a504bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:6528:x1874624962898560:12345-0@lo:101: 00010000:00010000:0.0:1787781790.215498:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781790.215508:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab799ff2/0xc6d6745c15063016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506300f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.215522:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab799ff2/0xc6d6745c15063016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506300f expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.215531:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab799ff2/0xc6d6745c15063016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506300f expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.215538:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab799ff2, rc 0) 00000100:00100000:0.0:1787781790.215569:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084a504bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962898560:12345-0@lo:101: Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.215576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781790.215621:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898560:0@lo:101: 00010000:00010000:0.0:1787781790.215631:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.215638:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.215703:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898688:0@lo:501: 00000100:00100000:0.0:1787781790.215738:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.215751:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fff8d3e going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.215761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898688 00000100:00100000:0.0:1787781790.215764:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898688 00000100:00100000:0.0:1787781790.215778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781790.215782:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e47a5fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962898688:12345-0@lo:501: 00000100:00100000:0.0:1787781790.215881:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e47a5fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962898688:12345-0@lo:501: Request processed in 98us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.215888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781790.215912:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898688:0@lo:501: 00000100:00100000:0.0:1787781790.215936:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898816:0@lo:503: 00000100:00100000:0.0:1787781790.215973:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.215994:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fff8d3e going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.216005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898816 00000100:00100000:0.0:1787781790.216008:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898816 00000100:00100000:0.0:1787781790.216024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781790.216029:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fcc622b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962898816:12345-0@lo:503: 00000100:00100000:0.0:1787781790.216122:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fcc622b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962898816:12345-0@lo:503: Request processed in 92us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.216128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781790.216164:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962898816:0@lo:503: 00000100:00100000:0.0:1787781790.216358:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7885:1874624962898944:0@lo:502: 00000100:00100000:0.0:1787781790.216387:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.216408:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962898944 00000100:00100000:0.0:1787781790.216411:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962898944 00000100:00100000:0.0:1787781790.216428:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781790.216433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046cf4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7885:x1874624962898944:12345-0@lo:502: 00000100:00100000:0.0:1787781790.216494:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046cf4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7885:x1874624962898944:12345-0@lo:502: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.216500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781790.216522:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.216531:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7885:1874624962898944:0@lo:502: 00000100:00100000:0.0:1787781790.216566:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7885:1874624962899072:0@lo:502: 00000100:00100000:0.0:1787781790.216595:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.216629:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899072 00000100:00100000:0.0:1787781790.216633:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899072 00000100:00100000:0.0:1787781790.216665:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787781790.216671:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c208b155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7885:x1874624962899072:12345-0@lo:502: 00000100:00100000:0.0:1787781790.216721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c208b155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:7885:x1874624962899072:12345-0@lo:502: Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.216727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787781790.216751:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.216761:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7885:1874624962899072:0@lo:502: 00000040:00080000:0.0:1787781790.216776:0:7885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787781790.216823:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787781790.216837:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781790.216843:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.216851:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000c18f1116/0xc6d6745c1506300f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781790.216864:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787781790.216866:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d47267800 from 4 10000000:01000000:0.0:1787781790.216868:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787781790.216886:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.216892:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.216899:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.216910:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899200:0@lo:101: 00000100:00100000:0.0:1787781790.216935:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.216947:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.216958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899200 00000100:00100000:0.0:1787781790.216961:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899200 00000100:00100000:0.0:1787781790.216976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787781790.216981:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000922ba501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962899200:12345-0@lo:101: 00010000:00010000:0.0:1787781790.216988:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781790.216997:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7a386d6/0xc6d6745c15063024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506301d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217012:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7a386d6/0xc6d6745c15063024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506301d expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217020:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7a386d6/0xc6d6745c15063024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506301d expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217046:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7a386d6, rc 0) 00000100:00100000:0.0:1787781790.217075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000922ba501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962899200:12345-0@lo:101: Request processed in 93us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.217080:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787781790.217106:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899200:0@lo:101: 00010000:00010000:0.0:1787781790.217115:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217122:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.217163:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899328:0@lo:256: 00000100:00100000:0.0:1787781790.217190:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.217201:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.217212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899328 00000100:00100000:0.0:1787781790.217215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899328 00000100:00100000:0.0:1787781790.217231:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787781790.217236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d06fa1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962899328:12345-0@lo:256: 20000000:01000000:0.0:1787781790.217246:0:6523:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787781790.217260:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787781790.217264:0:6523:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787781790.217329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d06fa1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962899328:12345-0@lo:256: Request processed in 92us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.217335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787781790.217360:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899328:0@lo:256: 10000000:01000000:0.0:1787781790.217396:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787781790.217405:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217412:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000005dfeb4e9/0xc6d6745c1506301d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781790.217419:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787781790.217421:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787781790.217423:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787781790.217443:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217450:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217457:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.217468:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899456:0@lo:101: 00000100:00100000:0.0:1787781790.217492:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.217504:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.217514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899456 00000100:00100000:0.0:1787781790.217517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899456 00000100:00100000:0.0:1787781790.217533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787781790.217538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019943003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962899456:12345-0@lo:101: 00010000:00010000:0.0:1787781790.217544:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781790.217550:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f923fb85/0xc6d6745c15063032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506302b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217562:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f923fb85/0xc6d6745c15063032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506302b expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217575:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f923fb85/0xc6d6745c15063032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506302b expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217582:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f923fb85, rc 0) 00000100:00100000:0.0:1787781790.217639:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019943003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962899456:12345-0@lo:101: Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.217645:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787781790.217671:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899456:0@lo:101: 00010000:00010000:0.0:1787781790.217680:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.217705:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.217750:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899584:0@lo:501: 00000100:00100000:0.0:1787781790.217774:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.217786:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.217797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899584 00000100:00100000:0.0:1787781790.217800:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899584 00000100:00100000:0.0:1787781790.217815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787781790.217820:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dad32be4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962899584:12345-0@lo:501: 00000100:00100000:0.0:1787781790.217907:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dad32be4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962899584:12345-0@lo:501: Request processed in 86us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.217914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787781790.217938:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899584:0@lo:501: 00000100:00100000:0.0:1787781790.217960:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899712:0@lo:503: 00000100:00100000:0.0:1787781790.217995:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.218007:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.218017:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899712 00000100:00100000:0.0:1787781790.218020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899712 00000100:00100000:0.0:1787781790.218048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787781790.218054:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a229174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962899712:12345-0@lo:503: 00000100:00100000:0.0:1787781790.218124:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a229174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962899712:12345-0@lo:503: Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.218131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787781790.218166:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962899712:0@lo:503: 00000100:00100000:1.0:1787781790.221884:0:7886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7886:1874624962899840:0@lo:502: 00000100:00100000:1.0:1787781790.221968:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781790.222011:0:7886:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d95b2e0d going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.222068:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899840 00000100:00100000:2.0:1787781790.222075:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899840 00000100:00100000:2.0:1787781790.222163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787781790.222183:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc63f452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:7886:x1874624962899840:12345-0@lo:502: 00000100:00100000:2.0:1787781790.222319:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc63f452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:7886:x1874624962899840:12345-0@lo:502: Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.222328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787781790.222426:0:7886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fa12358 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7886:1874624962899840:0@lo:502: 00000020:01000000:3.0:1787781790.222462:0:7886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781790.222474:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781790.222476:0:7886:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787781790.222482:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787781790.222487:0:7886:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:00000080:3.0:1787781790.222510:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781790.222523:0:7886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d7e4b338) 00000020:00000080:3.0:1787781790.222543:0:7886:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1787781790.222548:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787781790.222645:0:7886:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787781790.222651:0:7886:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787781790.222657:0:7886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15063040 00010000:00080000:3.0:1787781790.222685:0:7886:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000088882bcc@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787781790.229514:0:7886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787781790.231271:0:7886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787781790.231284:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787781790.231321:0:7886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787781790.231341:0:7886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15063047 00000100:00080000:3.0:1787781790.231350:0:7886:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781790.231354:0:7886:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000088882bcc using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787781790.231388:0:7886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef18bd53 x1874624962899968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787781790.231415:0:7886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787781790.231510:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef18bd53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962899968:0@lo:38: 00000100:00100000:0.0:1787781790.231572:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962900096:0@lo:400: 00000100:00100000:0.0:1787781790.231634:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.231703:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962900224:0@lo:400: 00000100:00100000:0.0:1787781790.231878:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.231906:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781790.231911:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962900352:0@lo:400: 00000100:00100000:0.0:1787781790.231931:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.231966:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900096 00000100:00100000:0.0:1787781790.231973:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900096 00000100:00100000:0.0:1787781790.232012:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900352 00000100:00100000:0.0:1787781790.232015:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900352 00000100:00100000:0.0:1787781790.232045:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781790.232053:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c21109d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962900096:12345-0@lo:400: 00000100:00100000:0.0:1787781790.232106:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c21109d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962900096:12345-0@lo:400: Request processed in 54us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.232113:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781790.232139:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781790.232146:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fc05e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962900352:12345-0@lo:400: 00000100:00100000:0.0:1787781790.232177:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fc05e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962900352:12345-0@lo:400: Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.232184:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781790.232202:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900224 00000100:00100000:0.0:1787781790.232206:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900224 00000100:00100000:0.0:1787781790.232232:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781790.232237:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005c52f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962900224:12345-0@lo:400: 00000100:00100000:0.0:1787781790.232269:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005c52f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962900224:12345-0@lo:400: Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.232275:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787781790.232329:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004771fb17 x1874624962900096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781790.232341:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962900096:0@lo:400: 00000040:01000000:3.0:1787781790.232499:0:7886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787781790.233218:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781790.233339:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962899968 00000100:00100000:3.0:1787781790.233345:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962899968 00000100:00100000:3.0:1787781790.233370:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787781790.233375:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003262ebda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624962899968:12345-0@lo:38: 00010000:00080000:3.0:1787781790.233400:0:6536:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1787781790.234052:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c1506304e 00000004:00100000:3.0:1787781790.234069:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787781790.234074:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1787781790.234792:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f9203cb8 x1874624962900352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781790.234810:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962900352:0@lo:400: 00000100:00100000:1.0:1787781790.234825:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc308305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962900224:0@lo:400: 00000100:00080000:1.0:1787781790.236713:0:7890:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000013ef375a x1874624962900480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781790.236803:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd7f6c09 going to sleep for 0 seconds 00000020:01000000:0.0:1787781790.236927:0:7886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781790.237028:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781790.237030:0:7886:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787781790.237043:0:7886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781790.237048:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781790.237049:0:7886:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781790.237053:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781790.237054:0:7886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787781790.237078:0:7886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7886:1874624962900608:0@lo:502: 00000100:00100000:0.0:1787781790.237156:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.237201:0:7886:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3feee3b going to sleep for 11 seconds 00000100:00100000:1.0:1787781790.237246:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900608 00000100:00100000:1.0:1787781790.237254:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900608 00000100:00100000:1.0:1787781790.237298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787781790.237306:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027e8da66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:7886:x1874624962900608:12345-0@lo:502: 00000100:00100000:1.0:1787781790.237415:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027e8da66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:7886:x1874624962900608:12345-0@lo:502: Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781790.237423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781790.237508:0:7886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:7886:1874624962900608:0@lo:502: 00000020:01000000:0.0:1787781790.237531:0:7886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781790.237540:0:7886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781790.237541:0:7886:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787781790.237545:0:7886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787781790.237714:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787781790.237809:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787781790.237818:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781790.237839:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 000000000081dd7e/0xc6d6745c1506302b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781790.237848:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787781790.237851:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993d588099b8 from 1 10000000:01000000:1.0:1787781790.237853:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781790.237875:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781790.237883:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781790.237891:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781790.237904:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da3a5d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962900736:0@lo:101: 00000100:00100000:1.0:1787781790.238285:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781790.238870:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d0af280 going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.239864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900736 00000100:00100000:0.0:1787781790.239875:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900736 00000100:00100000:0.0:1787781790.239920:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781790.239940:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe65ea2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962900736:12345-0@lo:101: 00010000:00010000:0.0:1787781790.239954:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781790.239969:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abe12a03/0xc6d6745c1506305c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063055 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.240001:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abe12a03/0xc6d6745c1506305c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.240011:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abe12a03/0xc6d6745c1506305c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.240018:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abe12a03, rc 0) 00000100:00100000:0.0:1787781790.240082:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe65ea2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962900736:12345-0@lo:101: Request processed in 155us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.240088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781790.242134:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da3a5d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962900736:0@lo:101: 00010000:00010000:0.0:1787781790.242162:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.242173:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781790.242254:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962900864:0@lo:501: 00000100:00100000:0.0:1787781790.242328:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.242389:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bf64158 going to sleep for 11 seconds 00000100:00100000:1.0:1787781790.242444:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900864 00000100:00100000:1.0:1787781790.242451:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900864 00000100:00100000:1.0:1787781790.242502:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787781790.242511:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009214a0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962900864:12345-0@lo:501: 00000100:00100000:1.0:1787781790.242631:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009214a0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962900864:12345-0@lo:501: Request processed in 121us (304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781790.242639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787781790.242979:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962900864:0@lo:501: 10000000:01000000:0.0:1787781790.243140:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787781790.243147:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781790.243156:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: 00000000bb97f0b5/0xc6d6745c15063055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781790.258134:0:6536:0:(import.c:65:import_set_state_nolock()) 00000000c3664b56 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781790.258232:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003262ebda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624962899968:12345-0@lo:38: Request processed in 24854us (25015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781790.258243:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787781790.258445:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787781790.258454:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787781790.258461:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787781790.258467:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787781790.258469:0:3656:0:(import.c:65:import_set_state_nolock()) 0000000088882bcc lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787781790.258491:0:3656:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000dd7f6c09): req@0000000013ef375a x1874624962900480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781790.258509:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef18bd53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962899968:0@lo:38: 00000100:00100000:2.0:1787781790.258572:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.258633:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd7f6c09 going to sleep for 11 seconds 00000100:00100000:0.0:1787781790.258818:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900480 00000100:00100000:0.0:1787781790.258824:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900480 00000100:00100000:2.0:1787781790.258972:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787781790.258981:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009d15c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962900480:12345-0@lo:1000: 00000100:00100000:2.0:1787781790.259059:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009d15c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962900480:12345-0@lo:1000: Request processed in 80us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.259066:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787781790.259090:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013ef375a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962900480:0@lo:1000: 00000040:01000000:2.0:1787781790.259119:0:7890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787781790.259152:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962900992:0@lo:1000: 00000100:00100000:2.0:1787781790.259976:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.260007:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962900992 00000100:00100000:2.0:1787781790.260012:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962900992 00000100:00100000:2.0:1787781790.260046:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787781790.260052:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afed9a81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962900992:12345-0@lo:1000: 00000100:00100000:2.0:1787781790.260149:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afed9a81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962900992:12345-0@lo:1000: Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.260157:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787781790.260176:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328c0c44 going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.260189:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962900992:0@lo:1000: 00000100:00100000:2.0:1787781790.260230:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901120:0@lo:700: 00000100:00100000:2.0:1787781790.260252:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.260275:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962901120 00000100:00100000:2.0:1787781790.260278:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962901120 00000100:00100000:2.0:1787781790.260306:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781790.260312:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c672efae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962901120:12345-0@lo:700: 00000100:00100000:2.0:1787781790.260340:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c672efae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962901120:12345-0@lo:700: Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.260353:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781790.260367:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021066a2c going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.260378:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901120:0@lo:700: 00000100:00100000:2.0:1787781790.260511:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901248:0@lo:1000: 00000100:00100000:2.0:1787781790.260535:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.260551:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962901248 00000100:00100000:2.0:1787781790.260555:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962901248 00000100:00100000:2.0:1787781790.260571:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787781790.260576:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b3bc294 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962901248:12345-0@lo:1000: 00000100:00100000:2.0:1787781790.260632:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b3bc294 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962901248:12345-0@lo:1000: Request processed in 56us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.260639:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787781790.260652:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7c3b9b5 going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.260664:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901248:0@lo:1000: 00000004:00080000:2.0:1787781790.260704:0:7890:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000021066a2c with version 0 00000020:00100000:2.0:1787781790.260717:0:7890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787781790.260724:0:7890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000529c077d x1874624962901504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787781790.260737:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901504:0@lo:1000: 00000100:00100000:2.0:1787781790.260759:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.260774:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962901504 00000100:00100000:2.0:1787781790.260777:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962901504 00000100:00100000:2.0:1787781790.260793:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787781790.260797:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018579b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7890:x1874624962901504:12345-0@lo:1000: 00000100:00100000:0.0:1787781790.261008:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962901632:0@lo:41: 00000100:00100000:0.0:1787781790.261058:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.261094:0:6537:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787781790.261101:0:6537:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787781790.261674:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e2bd4c3 going to sleep for 11 seconds 00000001:00080000:2.0:1787781790.269290:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787781790.269317:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787781790.269434:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018579b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7890:x1874624962901504:12345-0@lo:1000: Request processed in 8633us (8672us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787781790.269447:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787781790.269474:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962901632 00000100:00100000:2.0:1787781790.269481:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962901632 00000100:00100000:2.0:1787781790.269505:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787781790.269510:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc308305 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962901632:12345-0@lo:41: 00000004:00000024:2.0:1787781790.269538:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787781790.269572:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc308305 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962901632:12345-0@lo:41: Request processed in 62us (8515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.269578:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787781790.269642:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787781790.269653:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962901632:0@lo:41: 00000004:00080000:2.0:1787781790.269682:0:7890:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787781790.269692:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901504:0@lo:1000: 00000100:00100000:2.0:1787781790.269759:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901760:0@lo:1000: 00000100:00100000:2.0:1787781790.269794:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781790.269813:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962901760 00000100:00100000:2.0:1787781790.269816:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962901760 00000100:00100000:2.0:1787781790.269830:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787781790.269835:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082d4ae81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7890:x1874624962901760:12345-0@lo:1000: 00000100:00100000:2.0:1787781790.270006:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082d4ae81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7890:x1874624962901760:12345-0@lo:1000: Request processed in 170us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781790.270012:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787781790.270028:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328c0c44 going to sleep for 11 seconds 00000100:00100000:2.0:1787781790.270051:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529c077d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7890:1874624962901760:0@lo:1000: 00000040:00080000:2.0:1787781790.270071:0:7890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787781790.270097:0:7890:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000021066a2c with version 1 00000004:00080000:0.0:1787781790.271774:0:7887:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f1044743 version 1 rpc_version 1 00000020:00100000:0.0:1787781790.271805:0:7887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787781790.271814:0:7887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f9203cb8 x1874624962902016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787781790.271833:0:7887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7887:1874624962902016:0@lo:1000: 00000100:00100000:0.0:1787781790.271903:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781790.271932:0:7887:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d1a7a06 going to sleep for 11 seconds 00000100:00100000:1.0:1787781790.272794:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902016 00000100:00100000:1.0:1787781790.272804:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902016 00000100:00100000:1.0:1787781790.272868:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787781790.272883:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c49a1e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7887:x1874624962902016:12345-0@lo:1000: 00000040:00080000:2.0:1787781790.276250:0:7890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787781790.276327:0:7890:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787781790.276331:0:7890:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1787781790.277023:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787781790.277189:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c49a1e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7887:x1874624962902016:12345-0@lo:1000: Request processed in 4312us (5283us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787781790.277203:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787781790.277278:0:7887:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787781790.277283:0:7887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787781790.277299:0:7887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7887:1874624962902016:0@lo:1000: 00010000:00010000:3.0:1787781790.791893:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787781791.244012:0:7938:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffda0d0430 20000000:00000080:1.0:1787781791.244038:0:7938:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993d67cd9400 uarg=0000000000000000 20000000:01000000:1.0:1787781791.244089:0:7938:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787781791.244095:0:7938:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787781791.244099:0:7938:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787781791.244168:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787781791.244178:0:7938:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787781791.249152:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781791.249551:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787781791.249854:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787781791.249877:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787781791.249894:0:7938:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787781791.249912:0:7938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.249929:0:7938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062edb expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.249936:0:7938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.249943:0:7938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.249979:0:7938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.249992:0:7938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 17 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.250004:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7938:1874624962902144:0@lo:104: 00000100:00100000:0.0:1787781791.250076:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781791.250312:0:7938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.250321:0:7938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 17 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.250329:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7938:1874624962902272:0@lo:104: 00000100:00100000:0.0:1787781791.250352:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a16a67b going to sleep for 11 seconds 00000100:00100000:3.0:1787781791.250479:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787781791.250499:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781791.250529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902144 00000100:00100000:3.0:1787781791.250534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902144 00000100:00100000:3.0:1787781791.250568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902272 00000100:00100000:3.0:1787781791.250571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902272 00000100:00100000:3.0:1787781791.250599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781791.250731:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000525cc76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:7938:x1874624962902144:12345-0@lo:104: 00010000:00010000:3.0:1787781791.250744:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.250804:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781791.250809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000525cc76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:7938:x1874624962902144:12345-0@lo:104: Request processed in 205us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781791.250815:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781791.250849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781791.250855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034a095fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:7938:x1874624962902272:12345-0@lo:104: 00010000:00010000:3.0:1787781791.250862:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.250894:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787781791.250898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034a095fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:7938:x1874624962902272:12345-0@lo:104: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781791.250913:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787781791.250930:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781791.250935:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.250943:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000181a281c already unused, calling callback (000000006055e1c4) 10000000:00010000:3.0:1787781791.250945:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.250953:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781791.250959:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781791.250964:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781791.250989:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.250996:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781791.251011:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251017:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c15062fc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fd0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251028:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781791.251041:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251056:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c1d1047f already unused, calling callback (000000006055e1c4) 10000000:00010000:3.0:1787781791.251058:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251064:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781791.251069:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781791.251075:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781791.251087:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251093:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781791.251105:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251111:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: 00000000c1d1047f/0xc6d6745c15062edb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062ee2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781791.251124:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781791.251126:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781791.251127:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781791.251145:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef18bd53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962902400:0@lo:103: 00000100:00100000:3.0:1787781791.251174:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781791.251334:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962902528:0@lo:103: 00000100:00100000:1.0:1787781791.251364:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781791.251458:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781791.251523:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902400 00000100:00100000:0.0:1787781791.251528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902400 00010000:00010000:0.0:1787781791.251549:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 18 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.251576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902528 00000100:00100000:0.0:1787781791.251588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902528 00010000:00010000:0.0:1787781791.251600:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 19 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.251633:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781791.251639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e34b68dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624962902400:12345-0@lo:103: 00010000:00010000:0.0:1787781791.251649:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781791.251653:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251663:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251679:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781791.251704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e34b68dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624962902400:12345-0@lo:103: Request processed in 66us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781791.251711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781791.251726:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787781791.251731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b301b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3657:x1874624962902528:12345-0@lo:103: 00010000:00010000:0.0:1787781791.251738:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781791.251741:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 18 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251749:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 18 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251767:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251775:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251786:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251793:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251799:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251804:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251809:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006315ddd3 already unused, calling callback (000000003071bf1c) 00010000:00010000:0.0:1787781791.251812:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251819:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251827:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.251835:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781791.251859:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b301b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3657:x1874624962902528:12345-0@lo:103: Request processed in 129us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781791.251873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787781791.252107:0:7938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9103d67/0xc6d6745c15062fd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062fc9 expref: 17 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.252118:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7938:1874624962902144:0@lo:104: 00010000:00010000:0.0:1787781791.252126:0:7938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e903746/0xc6d6745c15062ee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062edb expref: 16 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781791.252134:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7938:1874624962902272:0@lo:104: 00010000:00010000:0.0:1787781791.252149:0:7938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.252156:0:7938:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.252161:0:7938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781791.252166:0:7938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006315ddd3/0xc6d6745c15063063 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781791.253377:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c03642 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962902528:0@lo:103: 00000100:00100000:3.0:1787781791.253483:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef18bd53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962902400:0@lo:103: 00010000:00010000:3.0:1787781791.813847:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781792.264236:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962902656:0@lo:41: 00000100:00100000:2.0:1787781792.264329:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781792.264492:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902656 00000100:00100000:0.0:1787781792.264502:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902656 00000100:00100000:0.0:1787781792.264566:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787781792.264576:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000529c077d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962902656:12345-0@lo:41: 00000004:00000024:0.0:1787781792.264637:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787781792.264708:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000529c077d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962902656:12345-0@lo:41: Request processed in 135us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781792.264716:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787781792.264930:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962902656:0@lo:41: 00010000:00010000:2.0:1787781792.849428:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781793.868580:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781794.888755:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781795.333802:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3cf297e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962902912:0@lo:400: 00000100:00100000:0.0:1787781795.333909:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781795.334210:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787781795.334219:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962902784:0@lo:400: 00000100:00100000:0.0:1787781795.334251:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781795.334275:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962903296:0@lo:400: 00000100:00100000:0.0:1787781795.334299:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781795.334323:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000709bffad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962903168:0@lo:400: 00000100:00100000:0.0:1787781795.334344:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781795.334362:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781795.334366:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec177ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962903040:0@lo:400: 00000100:00100000:0.0:1787781795.334388:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781795.334416:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902912 00000100:00100000:0.0:1787781795.334423:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902912 00000100:00100000:0.0:1787781795.334460:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903168 00000100:00100000:0.0:1787781795.334464:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903168 00000100:00100000:0.0:1787781795.334478:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787781795.334485:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e540672 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962902912:12345-0@lo:400: 00000100:00100000:0.0:1787781795.334536:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e540672 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962902912:12345-0@lo:400: Request processed in 52us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781795.334543:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787781795.334575:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781795.334581:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e0bcbcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962903168:12345-0@lo:400: 00000100:00100000:0.0:1787781795.334635:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e0bcbcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962903168:12345-0@lo:400: Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781795.334642:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781795.334670:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962902784 00000100:00100000:0.0:1787781795.334673:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962902784 00000100:00100000:0.0:1787781795.334700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781795.334705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e129e588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3660:x1874624962902784:12345-0@lo:400: 00000100:00100000:0.0:1787781795.334737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e129e588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3660:x1874624962902784:12345-0@lo:400: Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781795.334742:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781795.334772:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903296 00000100:00100000:0.0:1787781795.334775:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903296 00000100:00100000:0.0:1787781795.334797:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903040 00000100:00100000:0.0:1787781795.334800:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903040 00000100:00100000:0.0:1787781795.334813:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787781795.334817:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007764a82c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962903296:12345-0@lo:400: 00000100:00100000:0.0:1787781795.334851:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007764a82c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962903296:12345-0@lo:400: Request processed in 33us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781795.334857:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787781795.334869:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781795.334886:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa19ebaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962903040:12345-0@lo:400: 00000100:00100000:0.0:1787781795.334912:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa19ebaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962903040:12345-0@lo:400: Request processed in 39us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781795.334918:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787781795.335311:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004771fb17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962902784:0@lo:400: 00000100:00100000:1.0:1787781795.335328:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9203cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962903296:0@lo:400: 00010000:00080000:1.0:1787781795.335339:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c3cf297e x1874624962902912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781795.335349:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3cf297e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962902912:0@lo:400: 00000100:00100000:1.0:1787781795.335846:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781795.335858:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962903424:0@lo:41: 00000100:00100000:1.0:1787781795.335905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781795.335935:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903424 00000100:00100000:1.0:1787781795.335939:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903424 00000100:00100000:1.0:1787781795.336201:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787781795.336208:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ef375a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962903424:12345-0@lo:41: 00000004:00000024:1.0:1787781795.336235:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787781795.336276:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ef375a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962903424:12345-0@lo:41: Request processed in 69us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781795.336282:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787781795.336316:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000add8b408 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962903424:0@lo:41: 00000100:00100000:0.0:1787781795.336601:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec177ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962903040:0@lo:400: 00010000:00080000:0.0:1787781795.336641:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000709bffad x1874624962903168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781795.336651:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000709bffad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962903168:0@lo:400: 00010000:00010000:1.0:1787781795.911969:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787781796.869746:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781796.869753:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d80a11800 from 1 10000000:01000000:3.0:1787781796.869757:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781796.869800:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c1506306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.869811:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c1506306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.869821:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c1506306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781796.869843:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036be657e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903552:0@lo:101: 00000100:00100000:3.0:1787781796.869909:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781796.869958:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d95b2e0d going to sleep for 11 seconds 00000100:00100000:2.0:1787781796.870017:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903552 00000100:00100000:2.0:1787781796.870024:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903552 00000100:00100000:2.0:1787781796.870080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787781796.870088:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009452cac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962903552:12345-0@lo:101: 00010000:00010000:2.0:1787781796.870100:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781796.870113:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058998bcd/0xc6d6745c15063071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506306a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.870135:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058998bcd/0xc6d6745c15063071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506306a expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.870145:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058998bcd/0xc6d6745c15063071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506306a expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.870153:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058998bcd, rc 0) 00000100:00100000:2.0:1787781796.870204:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009452cac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962903552:12345-0@lo:101: Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781796.870211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787781796.870255:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036be657e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903552:0@lo:101: 00010000:00010000:2.0:1787781796.870267:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c1506306a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.870274:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: 00000000181a281c/0xc6d6745c1506306a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781796.870330:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903680:0@lo:501: 00000100:00100000:2.0:1787781796.870356:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781796.870370:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328c0c44 going to sleep for 11 seconds 00000100:00100000:2.0:1787781796.870382:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903680 00000100:00100000:2.0:1787781796.870385:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903680 00000100:00100000:2.0:1787781796.870406:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781796.870412:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af0c0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962903680:12345-0@lo:501: 00000100:00100000:2.0:1787781796.870516:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af0c0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962903680:12345-0@lo:501: Request processed in 104us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781796.870523:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781796.870552:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903680:0@lo:501: 00000100:00100000:2.0:1787781796.870578:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903808:0@lo:503: 00000100:00100000:2.0:1787781796.870763:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781796.872023:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328c0c44 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.872349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903808 00000100:00100000:3.0:1787781796.872357:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903808 00000100:00100000:3.0:1787781796.872746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781796.872756:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f889b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962903808:12345-0@lo:503: 00000100:00100000:3.0:1787781796.872881:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f889b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962903808:12345-0@lo:503: Request processed in 127us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.872888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787781796.876480:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962903808:0@lo:503: 00000100:00100000:2.0:1787781796.876831:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8211:1874624962903936:0@lo:502: 00000100:00100000:2.0:1787781796.876904:0:8211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781796.876944:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e440e663 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.877096:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962903936 00000100:00100000:3.0:1787781796.877103:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962903936 00000100:00100000:3.0:1787781796.877400:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787781796.877408:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fba10180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8211:x1874624962903936:12345-0@lo:502: 00000100:00100000:3.0:1787781796.877520:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fba10180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8211:x1874624962903936:12345-0@lo:502: Request processed in 113us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.877528:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787781796.878910:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed1a413a pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8211:1874624962903936:0@lo:502: 00000020:01000000:2.0:1787781796.878943:0:8211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781796.878952:0:8211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781796.878954:0:8211:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787781796.878960:0:8211:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d80a11800 00000020:00000080:2.0:1787781796.878962:0:8211:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781796.879018:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8211:1874624962904064:0@lo:502: 00000100:00100000:2.0:1787781796.879068:0:8211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781796.879096:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.879146:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904064 00000100:00100000:3.0:1787781796.879152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904064 00000100:00100000:3.0:1787781796.879193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787781796.879200:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8211:x1874624962904064:12345-0@lo:502: 00000100:00100000:3.0:1787781796.879285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8211:x1874624962904064:12345-0@lo:502: Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.879292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787781796.879359:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8211:1874624962904064:0@lo:502: 00000020:01000000:2.0:1787781796.879377:0:8211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781796.879381:0:8211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781796.879383:0:8211:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787781796.879386:0:8211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787781796.879520:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787781796.879542:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781796.879551:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.879762:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781796.879771:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781796.879774:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d47267800 from 1 10000000:01000000:3.0:1787781796.879777:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781796.879800:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.879808:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.879816:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781796.879828:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904192:0@lo:101: 00000100:00100000:3.0:1787781796.879856:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781796.879874:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781796.879920:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904192 00000100:00100000:2.0:1787781796.879925:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904192 00000100:00100000:2.0:1787781796.879954:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787781796.879960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962904192:12345-0@lo:101: 00010000:00010000:2.0:1787781796.879968:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781796.879980:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063078 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.880009:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063078 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.880020:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063078 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781796.880039:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:2.0:1787781796.880070:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962904192:12345-0@lo:101: Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781796.880076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787781796.880717:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904192:0@lo:101: 00010000:00010000:3.0:1787781796.880731:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781796.880740:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781796.880787:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904320:0@lo:501: 00000100:00100000:3.0:1787781796.880813:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781796.880834:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.880845:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904320 00000100:00100000:3.0:1787781796.880848:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904320 00000100:00100000:3.0:1787781796.880868:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787781796.880873:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962904320:12345-0@lo:501: 00000100:00100000:3.0:1787781796.880970:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962904320:12345-0@lo:501: Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.880976:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787781796.881016:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904320:0@lo:501: 00000100:00100000:3.0:1787781796.881041:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904448:0@lo:503: 00000100:00100000:3.0:1787781796.881074:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781796.881086:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.881095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904448 00000100:00100000:3.0:1787781796.881098:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904448 00000100:00100000:3.0:1787781796.881112:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787781796.881117:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962904448:12345-0@lo:503: 00000100:00100000:3.0:1787781796.881176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962904448:12345-0@lo:503: Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.881190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787781796.881220:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962904448:0@lo:503: 00000100:00100000:1.0:1787781796.882347:0:8212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8212:1874624962904576:0@lo:502: 00000100:00100000:1.0:1787781796.882395:0:8212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781796.882427:0:8212:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781796.882468:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904576 00000100:00100000:3.0:1787781796.882473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904576 00000100:00100000:3.0:1787781796.882510:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787781796.882519:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8212:x1874624962904576:12345-0@lo:502: 00000100:00100000:3.0:1787781796.882918:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8212:x1874624962904576:12345-0@lo:502: Request processed in 399us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781796.882926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787781796.883484:0:8212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8212:1874624962904576:0@lo:502: 00000020:01000000:1.0:1787781796.883510:0:8212:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781796.883519:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781796.883521:0:8212:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787781796.883527:0:8212:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d47267800 00000020:00000080:1.0:1787781796.883530:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787781796.883790:0:8212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8212:1874624962904704:0@lo:502: 00000100:00100000:1.0:1787781796.883837:0:8212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781796.883872:0:8212:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781796.883948:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904704 00000100:00100000:2.0:1787781796.883953:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904704 00000100:00100000:2.0:1787781796.883992:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787781796.884012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8212:x1874624962904704:12345-0@lo:502: 00000100:00100000:2.0:1787781796.884112:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8212:x1874624962904704:12345-0@lo:502: Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781796.884119:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787781796.884212:0:8212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8212:1874624962904704:0@lo:502: 00000020:01000000:1.0:1787781796.884230:0:8212:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781796.884235:0:8212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781796.884237:0:8212:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787781796.884240:0:8212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787781796.884376:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787781796.884401:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781796.884410:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781796.884421:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781796.934087:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781797.384268:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962904832:0@lo:41: 00000100:00100000:2.0:1787781797.384341:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781797.384413:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904832 00000100:00100000:2.0:1787781797.384420:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904832 00000100:00100000:2.0:1787781797.384467:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787781797.384476:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962904832:12345-0@lo:41: 00000004:00000024:2.0:1787781797.384507:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787781797.384553:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962904832:12345-0@lo:41: Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781797.384560:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787781797.384622:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962904832:0@lo:41: 00010000:00010000:1.0:1787781797.958132:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781798.985554:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781800.013748:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781800.453879:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962904960:0@lo:41: 00000100:00100000:2.0:1787781800.453958:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781800.454182:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962905216:0@lo:400: 00000100:00100000:3.0:1787781800.454201:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962905088:0@lo:400: 00000100:00100000:0.0:1787781800.454271:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781800.454272:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781800.454342:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905216 00000100:00100000:0.0:1787781800.454352:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905216 00000100:00100000:2.0:1787781800.454373:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905088 00000100:00100000:2.0:1787781800.454382:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905088 00000100:00100000:2.0:1787781800.454436:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787781800.454444:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3659:x1874624962905088:12345-0@lo:400: 00000100:00100000:2.0:1787781800.454499:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3659:x1874624962905088:12345-0@lo:400: Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781800.454507:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787781800.454548:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787781800.454558:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962905344:0@lo:400: 00000100:00100000:0.0:1787781800.454562:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962905216:12345-0@lo:400: 00000100:00100000:2.0:1787781800.454594:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781800.454666:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962905216:12345-0@lo:400: Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781800.454675:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787781800.454680:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781800.454694:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962905472:0@lo:400: 00000100:00100000:2.0:1787781800.454733:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787781800.454735:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993d4beaa940 x1874624962905216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781800.454753:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962905216:0@lo:400: 00000100:00100000:2.0:1787781800.454778:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962904960 00000100:00100000:2.0:1787781800.454784:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962904960 00000100:00100000:2.0:1787781800.454822:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905344 00000100:00100000:2.0:1787781800.454825:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905344 00000100:00100000:2.0:1787781800.454841:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781800.454849:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962904960:12345-0@lo:41: 00000004:00000024:2.0:1787781800.454875:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787781800.454908:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962904960:12345-0@lo:41: Request processed in 60us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781800.454915:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781800.454929:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781800.454936:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962905344:12345-0@lo:400: 00000100:00100000:2.0:1787781800.454968:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962905344:12345-0@lo:400: Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781800.454975:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781800.455019:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905472 00000100:00100000:2.0:1787781800.455023:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905472 00000100:00100000:2.0:1787781800.455046:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787781800.455053:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962905472:12345-0@lo:400: 00000100:00100000:2.0:1787781800.455085:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962905472:12345-0@lo:400: Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781800.455091:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787781800.455132:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962905088:0@lo:400: 00010000:00080000:2.0:1787781800.455168:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993d4bea9a40 x1874624962905472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781800.455180:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962905472:0@lo:400: 00000100:00100000:2.0:1787781800.455190:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962905344:0@lo:400: 00000100:00100000:2.0:1787781800.456024:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962904960:0@lo:41: 00000020:01000004:1.0:1787781800.756545:0:8438:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787781800.756554:0:8438:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787781800.756556:0:8438:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787781800.756730:0:8438:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993d7236f800 00000020:01000004:1.0:1787781800.756747:0:8438:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787781800.756760:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787781800.756773:0:8438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff993d67c43370) 00000020:00000080:1.0:1787781800.756789:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787781800.807239:0:8438:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787781800.807306:0:8438:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787781800.852389:0:8438:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787781800.852651:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787781800.852664:0:8438:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787781800.852675:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6d6745c1506308d 00000020:01000004:0.0:1787781800.852683:0:8438:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787781800.852703:0:8438:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787781800.852706:0:8438:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787781800.852713:0:8438:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787781800.852723:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787781800.852739:0:8438:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff993d5ea94d28) 00000020:00000080:0.0:1787781800.852751:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787781800.866562:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781800.866774:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787781800.866781:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787781800.867510:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787781800.867518:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787781800.868284:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787781800.868291:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787781800.876022:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781800.876220:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787781800.876226:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787781800.877634:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787781800.877643:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787781800.909759:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781800.910136:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787781800.910143:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787781800.911523:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787781800.911753:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787781800.913487:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787781800.913501:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787781800.916471:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781800.917027:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787781800.917034:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787781800.917781:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787781800.917790:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787781800.962248:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781800.962484:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787781800.962491:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787781800.964597:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787781800.964657:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787781800.965144:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787781800.965171:0:8438:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787781800.965177:0:8438:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787781800.992059:0:8438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787781800.992099:0:8438:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.116@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787781800.992103:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787781800.992105:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787781800.992106:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781800.992108:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781800.992109:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781800.992110:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781800.992112:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781800.992118:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781800.992119:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781800.992120:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781800.992122:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787781800.992126:0:8438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787781800.992128:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787781800.992129:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787781800.992130:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781800.992131:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781800.992132:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781800.992133:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781800.992134:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781800.992135:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781800.992136:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781800.992137:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781800.992138:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787781800.992163:0:8438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787781800.992181:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962905600:0@lo:253: 00000100:00100000:2.0:1787781800.992253:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781800.992359:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d467eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787781800.992434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905600 00000100:00100000:0.0:1787781800.992441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905600 00000100:00100000:0.0:1787781800.992600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781800.992695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8438:x1874624962905600:12345-0@lo:253: 20000000:01000000:0.0:1787781800.992726:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787781800.992730:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787781800.992735:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787781800.992738:0:6523:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787781800.993027:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781800.993164:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787781800.993179:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787781800.993195:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787781800.993200:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787781800.993223:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787781800.993261:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787781800.993349:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787781800.993364:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:0.0:1787781800.993366:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:0.0:1787781800.993382:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787781800.993390:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787781800.993404:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787781800.993409:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:0.0:1787781800.993422:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787781800.993429:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787781800.993442:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787781800.993458:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787781800.993784:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787781800.993872:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:0.0:1787781800.993875:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:0.0:1787781800.993897:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787781800.993905:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787781800.993919:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787781800.993925:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:0.0:1787781800.993938:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787781800.993944:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787781800.993958:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787781800.993984:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787781800.994388:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787781800.994402:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:0.0:1787781800.994404:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:0.0:1787781800.994419:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787781800.994425:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787781800.994440:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787781800.994446:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:0.0:1787781800.994485:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787781800.994493:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787781800.994506:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787781800.994524:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787781800.996940:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787781800.996948:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787781800.996952:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787781800.997026:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787781800.997029:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781800.997695:0:8457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781800.997743:0:8457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781800.997764:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787781800.998086:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787781800.998112:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787781800.998131:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1787781800.998141:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787781800.998142:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787781800.998936:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787781800.998967:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787781800.998998:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787781800.999251:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787781800.999273:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787781800.999288:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787781800.999309:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787781800.999312:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787781800.999959:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787781801.000144:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787781801.000167:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787781801.000183:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787781801.000192:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787781801.000194:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787781801.003190:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787781801.003249:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787781801.003271:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787781801.003929:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787781801.003958:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787781801.003987:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1787781801.004006:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781801.004025:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004042:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004049:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004057:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506300f expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004065:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506302b expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004072:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004081:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004118:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004147:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.004163:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905728:0@lo:104: 00000100:00100000:2.0:1787781801.004251:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781801.004350:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004359:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.004369:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905856:0@lo:104: 00000100:00100000:2.0:1787781801.004393:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781801.004471:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.004481:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.004490:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905984:0@lo:104: 00000100:00100000:2.0:1787781801.004522:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.004743:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905728 00000100:00100000:0.0:1787781801.004751:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905728 00000100:00100000:0.0:1787781801.004787:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905856 00000100:00100000:0.0:1787781801.004790:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905856 00000100:00100000:0.0:1787781801.004879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781801.004891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962905728:12345-0@lo:104: 00010000:00010000:0.0:1787781801.004905:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.004966:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781801.004972:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962905728:12345-0@lo:104: Request processed in 85us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.004990:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781801.005007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781801.005014:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962905856:12345-0@lo:104: 00010000:00010000:0.0:1787781801.005022:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005055:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781801.005061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962905856:12345-0@lo:104: Request processed in 48us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.005077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787781801.005098:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781801.005105:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005113:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.005117:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005127:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.005135:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.005141:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.005169:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005176:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.005194:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005201:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506305c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.005214:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781801.005217:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.006487:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.006817:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.006824:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.006835:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.006843:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.006849:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.006889:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.006896:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.006907:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.006914:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506302b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063032 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.006927:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.006929:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.006931:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781801.006958:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906112:0@lo:103: 00000100:00100000:0.0:1787781801.007029:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.007075:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781801.007081:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906240:0@lo:103: 00000100:00100000:0.0:1787781801.007122:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.007154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906112 00000100:00100000:0.0:1787781801.007160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906112 00010000:00010000:0.0:1787781801.007191:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.007215:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906240 00000100:00100000:0.0:1787781801.007218:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906240 00010000:00010000:0.0:1787781801.007230:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.007244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781801.007252:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3659:x1874624962906112:12345-0@lo:103: 00010000:00010000:0.0:1787781801.007264:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.007270:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.007281:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.007299:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.007332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3659:x1874624962906112:12345-0@lo:103: Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.007339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781801.007355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781801.007361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624962906240:12345-0@lo:103: 00010000:00010000:0.0:1787781801.007369:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.007373:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.007408:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.007419:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.007442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624962906240:12345-0@lo:103: Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.007448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781801.007484:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906240:0@lo:103: 00000100:00100000:0.0:1787781801.007493:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906112:0@lo:103: 00010000:00010000:2.0:1787781801.007878:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.007891:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.007902:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d46940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962906368:0@lo:104: 00000100:00100000:2.0:1787781801.007940:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781801.008140:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.008150:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.008160:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962906496:0@lo:104: 00000100:00100000:2.0:1787781801.008185:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781801.008212:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962905984 00000100:00100000:3.0:1787781801.008218:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962905984 00000100:00100000:3.0:1787781801.008249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906368 00000100:00100000:3.0:1787781801.008251:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906368 00000100:00100000:3.0:1787781801.008265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787781801.008273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962905984:12345-0@lo:104: 00010000:00010000:3.0:1787781801.008284:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.008343:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781801.008349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962905984:12345-0@lo:104: Request processed in 78us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.008356:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787781801.008371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787781801.008389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962906368:12345-0@lo:104: 00010000:00010000:3.0:1787781801.008396:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.008427:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787781801.008432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962906368:12345-0@lo:104: Request processed in 56us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.008438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787781801.008482:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781801.008488:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008495:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.008498:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008506:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.008514:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.008520:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.008554:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008561:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.008598:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008625:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506300f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063016 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008641:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781801.008645:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008651:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.008654:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008660:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.008667:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.008673:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.008687:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008693:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.008698:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008705:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d40030a00/0xc6d6745c15062fd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062fde expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008715:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.008722:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.008724:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781801.008741:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962906752:0@lo:103: 00000100:00100000:0.0:1787781801.008771:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.008793:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781801.008799:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962906624:0@lo:103: 00000100:00100000:0.0:1787781801.008833:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.008856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906752 00000100:00100000:0.0:1787781801.008859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906752 00010000:00010000:0.0:1787781801.008878:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.008896:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906624 00000100:00100000:0.0:1787781801.008898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906624 00010000:00010000:0.0:1787781801.008910:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.008923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781801.008930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3658:x1874624962906752:12345-0@lo:103: 00010000:00010000:0.0:1787781801.008939:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.008943:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008954:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 20 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.008967:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.009009:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3658:x1874624962906752:12345-0@lo:103: Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.009016:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781801.009036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781801.009043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3658:x1874624962906624:12345-0@lo:103: 00010000:00010000:0.0:1787781801.009051:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.009056:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.009065:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 19 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.009075:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.009100:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3658:x1874624962906624:12345-0@lo:103: Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.009106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781801.009138:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962906624:0@lo:103: 00000100:00100000:0.0:1787781801.009147:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962906752:0@lo:103: 00010000:00010000:0.0:1787781801.009165:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781801.009728:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d467eb480 going to sleep for 11 seconds 00010000:00010000:2.0:1787781801.009745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9c00/0xc6d6745c1506305c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063055 expref: 18 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.009756:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905728:0@lo:104: 00010000:00010000:2.0:1787781801.009767:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9000/0xc6d6745c15063032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506302b expref: 17 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.009774:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905856:0@lo:104: 00010000:00010000:2.0:1787781801.009782:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d40031600/0xc6d6745c15063016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506300f expref: 16 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.009790:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962905984:0@lo:104: 00010000:00010000:2.0:1787781801.009855:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166000/0xc6d6745c15062fde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062fd7 expref: 15 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.009867:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d46940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962906368:0@lo:104: 00000100:00100000:3.0:1787781801.009919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906496 00000100:00100000:3.0:1787781801.009924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906496 00000100:00100000:3.0:1787781801.010009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787781801.010018:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962906496:12345-0@lo:104: 00010000:00010000:3.0:1787781801.010028:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.010086:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781801.010092:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962906496:12345-0@lo:104: Request processed in 77us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.010098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787781801.010135:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781801.010140:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010148:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.010151:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010159:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.010167:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.010188:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.010217:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010223:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.010237:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c15062f60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15062f67 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010259:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.010261:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.010262:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781801.010280:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906880:0@lo:103: 00000100:00100000:0.0:1787781801.010315:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.010345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962906880 00000100:00100000:0.0:1787781801.010349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962906880 00010000:00010000:0.0:1787781801.010368:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 15 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.010401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781801.010408:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3659:x1874624962906880:12345-0@lo:103: 00010000:00010000:0.0:1787781801.010417:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.010421:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 15 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010430:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 15 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010450:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010458:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010472:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010478:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010485:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010491:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010495:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41481200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781801.010499:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010506:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010514:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.010522:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.010561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3659:x1874624962906880:12345-0@lo:103: Request processed in 154us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.010576:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781801.010653:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962906880:0@lo:103: 00010000:00010000:2.0:1787781801.010857:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166200/0xc6d6745c15062f67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15062f60 expref: 14 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.010880:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962906496:0@lo:104: 00010000:00010000:2.0:1787781801.010907:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.010917:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.010923:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.010930:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41481200/0xc6d6745c1506309b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787781801.010943:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787781801.013208:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:8438:x1874624962905600:12345-0@lo:253: Request processed in 20509us (20946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781801.013222:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781801.013319:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962905600:0@lo:253: 10000000:01000000:0.0:1787781801.013334:0:8438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787781801.013337:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787781801.013339:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787781801.013340:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781801.013342:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787781801.013343:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781801.013345:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781801.013346:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787781801.013348:0:8438:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787781801.013349:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781801.013351:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787781801.013371:0:8438:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993d7236f800 from lustre-OST0000 10000000:01000000:0.0:1787781801.013466:0:8438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787781801.013469:0:8438:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787781801.013478:0:8438:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993d588099b8 local copy 10000000:01000000:0.0:1787781801.013482:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787781801.013516:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.013594:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.013631:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.013651:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907008:0@lo:101: 00000100:00100000:0.0:1787781801.013688:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.013723:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787781801.013799:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907008 00000100:00100000:2.0:1787781801.013815:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907008 00000100:00100000:2.0:1787781801.013860:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787781801.013869:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:8438:x1874624962907008:12345-0@lo:101: 00010000:00010000:2.0:1787781801.013882:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781801.013896:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480e00/0xc6d6745c150630a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150630a2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.013917:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480e00/0xc6d6745c150630a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150630a2 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.013927:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480e00/0xc6d6745c150630a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630a2 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.013943:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480e00, rc 0) 00000100:00100000:2.0:1787781801.013986:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907008:12345-0@lo:101: Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781801.013993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787781801.014123:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907008:0@lo:101: 00010000:00010000:0.0:1787781801.014136:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.014145:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.014229:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907136:0@lo:501: 00000100:00100000:0.0:1787781801.014258:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.014285:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787781801.014330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907136 00000100:00100000:2.0:1787781801.014335:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907136 00000100:00100000:2.0:1787781801.014406:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787781801.014413:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907136:12345-0@lo:501: 00000100:00100000:2.0:1787781801.014472:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907136:12345-0@lo:501: Request processed in 60us (213us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781801.014478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787781801.015051:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907136:0@lo:501: 10000000:01000000:0.0:1787781801.015066:0:8438:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787781801.015088:0:8438:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787781801.015095:0:8438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015104:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015111:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015129:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787781801.015154:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d7236f800 00010000:00010000:0.0:1787781801.015164:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781801.015170:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015178:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781801.015192:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015202:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781801.015209:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781801.015216:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781801.015237:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015244:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781801.015262:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015269:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150630a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150630a9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015285:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.015287:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781801.015289:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781801.015300:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962907264:0@lo:103: 00000100:00100000:0.0:1787781801.015338:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.015385:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907264 00000100:00100000:0.0:1787781801.015390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907264 00000100:00100000:0.0:1787781801.015424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781801.015433:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3660:x1874624962907264:12345-0@lo:103: 00010000:00010000:0.0:1787781801.015443:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781801.015464:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480e00/0xc6d6745c150630a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c150630a2 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015477:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781801.015505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:3660:x1874624962907264:12345-0@lo:103: Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.015513:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781801.015901:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962907264:0@lo:103: 10000000:01000000:0.0:1787781801.015921:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787781801.015928:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787781801.015931:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787781801.015937:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787781801.015939:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787781801.015960:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015968:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781801.015990:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781801.016005:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907392:0@lo:101: 00000100:00100000:0.0:1787781801.016036:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.016139:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787781801.016252:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907392 00000100:00100000:3.0:1787781801.016256:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907392 00000100:00100000:3.0:1787781801.016325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781801.016343:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+13:8438:x1874624962907392:12345-0@lo:101: 00010000:00010000:3.0:1787781801.016355:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781801.016366:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150630b0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.016405:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.016415:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.016422:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150fa00, rc 0) 00000100:00100000:3.0:1787781801.016464:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907392:12345-0@lo:101: Request processed in 124us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.016470:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787781801.016539:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907392:0@lo:101: 00010000:00010000:1.0:1787781801.016553:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.016562:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781801.016684:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907520:0@lo:501: 00000100:00100000:1.0:1787781801.016712:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.017065:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781801.017119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907520 00000100:00100000:0.0:1787781801.017124:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907520 00000100:00100000:0.0:1787781801.017145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787781801.017150:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907520:12345-0@lo:501: 00000100:00100000:0.0:1787781801.017278:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907520:12345-0@lo:501: Request processed in 126us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.017285:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787781801.017392:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907520:0@lo:501: 00000100:00100000:1.0:1787781801.017427:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907648:0@lo:503: 00000100:00100000:1.0:1787781801.017462:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.017480:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781801.017515:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907648 00000100:00100000:0.0:1787781801.017519:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907648 00000100:00100000:0.0:1787781801.017596:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787781801.017602:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907648:12345-0@lo:503: 00000100:00100000:0.0:1787781801.017739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907648:12345-0@lo:503: Request processed in 137us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.017746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787781801.017881:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907648:0@lo:503: 00000040:00080000:1.0:1787781801.018116:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787781801.018183:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907776:0@lo:502: 00000100:00100000:1.0:1787781801.018216:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.018236:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781801.018278:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907776 00000100:00100000:0.0:1787781801.018282:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907776 00000100:00100000:0.0:1787781801.018300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787781801.018306:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907776:12345-0@lo:502: 00000100:00100000:0.0:1787781801.018377:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907776:12345-0@lo:502: Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.018383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787781801.018442:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907776:0@lo:502: 00000040:00080000:1.0:1787781801.018705:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787781801.018726:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787781801.018736:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787781801.018746:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787781801.018757:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787781801.018767:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787781801.018783:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907904:0@lo:502: 00000100:00100000:1.0:1787781801.018913:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.018955:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781801.019044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962907904 00000100:00100000:2.0:1787781801.019049:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962907904 00000100:00100000:0.0:1787781801.019154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787781801.019162:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907904:12345-0@lo:502: 00000100:00100000:0.0:1787781801.019233:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962907904:12345-0@lo:502: Request processed in 71us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.019239:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787781801.019312:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962907904:0@lo:502: 00000040:00080000:1.0:1787781801.019349:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787781801.019356:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787781801.019733:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787781801.019740:0:8461:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787781801.019745:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781801.019747:0:8461:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787781801.019752:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787781801.019770:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff993d5ea90000) 00000020:00000080:0.0:1787781801.019788:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787781801.019793:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787781801.019866:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7236f800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787781801.019873:0:8461:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787781801.019879:0:8461:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6d6745c150630c5 00010000:00010000:1.0:1787781801.028528:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787781801.028866:0:8461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787781801.033836:0:8461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 00010000:00010000:1.0:1787781801.034401:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1787781801.034495:0:8461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787781801.040694:0:8461:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787781801.040900:0:8461:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787781801.049120:0:8461:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787781801.052632:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787781801.052647:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781801.052672:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781801.052674:0:8461:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787781801.052678:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781801.052682:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781801.052684:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781801.052687:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781801.052689:0:8461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787781801.052717:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781801.052719:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781801.052720:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787781801.052724:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787781801.053504:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787781801.053849:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787781801.053877:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.053890:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781801.053999:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7236f800 from 1 10000000:01000000:2.0:1787781801.054003:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781801.054038:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.054046:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.054057:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.054079:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908032:0@lo:101: 00000100:00100000:2.0:1787781801.054146:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781801.054200:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45033480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781801.054262:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908032 00000100:00100000:3.0:1787781801.054269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908032 00000100:00100000:3.0:1787781801.054317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787781801.054326:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:8438:x1874624962908032:12345-0@lo:101: 00010000:00010000:3.0:1787781801.054339:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781801.054352:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150630cc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.054372:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150630cc expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.054382:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630cc expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.054390:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e400, rc 0) 00000100:00100000:3.0:1787781801.054433:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908032:12345-0@lo:101: Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.054440:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787781801.054527:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908032:0@lo:101: 00010000:00010000:2.0:1787781801.054547:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.054555:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.054666:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908160:0@lo:501: 00000100:00100000:2.0:1787781801.054698:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781801.054717:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45033480 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.054776:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908160 00000100:00100000:1.0:1787781801.054781:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908160 00000100:00100000:1.0:1787781801.054814:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787781801.054830:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908160:12345-0@lo:501: 00000100:00100000:1.0:1787781801.054939:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908160:12345-0@lo:501: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.054947:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781801.055027:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908160:0@lo:501: 00000100:00100000:2.0:1787781801.055052:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908288:0@lo:503: 00000100:00100000:2.0:1787781801.055089:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781801.055115:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45033480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781801.055169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908288 00000100:00100000:3.0:1787781801.055173:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908288 00000100:00100000:3.0:1787781801.055201:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787781801.055207:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908288:12345-0@lo:503: 00000100:00100000:3.0:1787781801.055287:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908288:12345-0@lo:503: Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.055294:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787781801.055370:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908288:0@lo:503: 00000040:00080000:2.0:1787781801.055595:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787781801.055686:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908416:0@lo:502: 00000100:00100000:2.0:1787781801.055724:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781801.055744:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45033480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781801.055799:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908416 00000100:00100000:3.0:1787781801.055803:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908416 00000100:00100000:3.0:1787781801.055834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787781801.055841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908416:12345-0@lo:502: 00000100:00100000:3.0:1787781801.055912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908416:12345-0@lo:502: Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.055919:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787781801.056008:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908416:0@lo:502: 00000040:00080000:2.0:1787781801.056168:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787781801.056192:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787781801.056211:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908544:0@lo:502: 00000100:00100000:2.0:1787781801.056242:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781801.056264:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45033480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781801.056314:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908544 00000100:00100000:3.0:1787781801.056318:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908544 00000100:00100000:3.0:1787781801.056348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787781801.056354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908544:12345-0@lo:502: 00000100:00100000:3.0:1787781801.056414:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908544:12345-0@lo:502: Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781801.056420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787781801.056540:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908544:0@lo:502: 00000040:00080000:2.0:1787781801.056582:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787781801.056590:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787781801.057042:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781801.057052:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781801.057054:0:8465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787781801.057061:0:8465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d7236f800 00000020:00000080:2.0:1787781801.057064:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787781801.057073:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781801.057077:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781801.057078:0:8465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787781801.057080:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787781801.057180:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787781801.057205:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781801.057225:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.057242:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781801.057299:0:8438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787781801.057302:0:8438:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d7236f800 10000000:01000000:3.0:1787781801.057305:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d7236f800 10000000:01000000:3.0:1787781801.057310:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787781801.057316:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d7236f800 from 1 10000000:01000000:3.0:1787781801.057318:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781801.057354:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.057362:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.057370:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781801.057384:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908672:0@lo:101: 00000100:00100000:3.0:1787781801.057420:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781801.057455:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.057509:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908672 00000100:00100000:1.0:1787781801.057514:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908672 00000100:00100000:1.0:1787781801.057551:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787781801.057559:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8438:x1874624962908672:12345-0@lo:101: 00010000:00010000:1.0:1787781801.057569:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781801.057583:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150630da expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.057631:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150630da expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.057644:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630da expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.057653:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039800, rc 0) 00000100:00100000:1.0:1787781801.057693:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962908672:12345-0@lo:101: Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.057699:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787781801.057737:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908672:0@lo:101: 00010000:00010000:1.0:1787781801.057751:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.057760:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781801.057843:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908800:0@lo:501: 00000100:00100000:1.0:1787781801.057868:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.057891:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908800 00000100:00100000:1.0:1787781801.057895:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908800 00000100:00100000:1.0:1787781801.057918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787781801.057925:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962908800:12345-0@lo:501: 00000100:00100000:1.0:1787781801.058024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962908800:12345-0@lo:501: Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.058031:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787781801.058054:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.058066:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908800:0@lo:501: 00000100:00100000:1.0:1787781801.058089:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908928:0@lo:503: 00000100:00100000:1.0:1787781801.058124:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.058143:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962908928 00000100:00100000:1.0:1787781801.058146:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962908928 00000100:00100000:1.0:1787781801.058165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787781801.058171:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962908928:12345-0@lo:503: 00000100:00100000:1.0:1787781801.058238:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962908928:12345-0@lo:503: Request processed in 66us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.058244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787781801.058277:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.058289:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962908928:0@lo:503: 00000040:00080000:1.0:1787781801.058509:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787781801.058575:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962909056:0@lo:502: 00000100:00100000:1.0:1787781801.058634:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.058657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909056 00000100:00100000:1.0:1787781801.058661:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909056 00000100:00100000:1.0:1787781801.058685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787781801.058691:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962909056:12345-0@lo:502: 00000100:00100000:1.0:1787781801.058769:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962909056:12345-0@lo:502: Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.058776:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787781801.058806:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.058819:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962909056:0@lo:502: 00000040:00080000:1.0:1787781801.058972:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787781801.059011:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787781801.059024:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787781801.059049:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787781801.059062:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787781801.059074:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787781801.059085:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787781801.059097:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787781801.059111:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787781801.059124:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787781801.059136:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787781801.059148:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787781801.059158:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787781801.059170:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787781801.059181:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787781801.059192:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787781801.059204:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787781801.059216:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787781801.059227:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787781801.059251:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787781801.059273:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787781801.059286:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787781801.059298:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787781801.059311:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787781801.059321:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787781801.059333:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787781801.059343:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787781801.059356:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787781801.059368:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787781801.059380:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787781801.059392:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787781801.059405:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787781801.059418:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787781801.059430:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787781801.059442:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787781801.059469:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787781801.059483:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787781801.059504:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962909184:0@lo:502: 00000100:00100000:1.0:1787781801.059546:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.059569:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909184 00000100:00100000:1.0:1787781801.059573:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909184 00000100:00100000:1.0:1787781801.059597:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787781801.059604:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962909184:12345-0@lo:502: 00000100:00100000:1.0:1787781801.059692:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962909184:12345-0@lo:502: Request processed in 87us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.059698:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787781801.059733:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.059746:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962909184:0@lo:502: 00000040:00080000:1.0:1787781801.059783:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787781801.059790:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787781801.063726:0:8466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787781801.063743:0:8466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff993d58808000) 00000020:00000080:2.0:1787781801.063767:0:8466:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787781801.063839:0:8466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7236f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787781801.063843:0:8466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7236f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787781801.063846:0:8466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7236f800 3 00010000:00080000:2.0:1787781801.063871:0:8466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d77182800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787781801.071055:0:8466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787781801.074402:0:8466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787781801.074448:0:8466:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787781801.074463:0:8466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6d6745c150630ef 00000100:00080000:2.0:1787781801.074473:0:8466:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781801.074479:0:8466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787781801.074513:0:8466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c41d44000 x1874624962909312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781801.074547:0:8466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787781801.074646:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624962909312:0@lo:38: 00000100:00100000:0.0:1787781801.074712:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.074770:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962909568:0@lo:400: 00000100:00100000:0.0:1787781801.074795:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.074828:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781801.074834:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962909440:0@lo:400: 00000100:00100000:0.0:1787781801.074865:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.074890:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962909696:0@lo:400: 00000100:00100000:0.0:1787781801.074909:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.074925:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781801.074930:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962909824:0@lo:400: 00000100:00100000:0.0:1787781801.074949:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781801.074991:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909312 00000100:00100000:0.0:1787781801.074997:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909312 00000100:00100000:0.0:1787781801.075017:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909440 00000100:00100000:0.0:1787781801.075019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909440 00000100:00100000:0.0:1787781801.075037:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909696 00000100:00100000:0.0:1787781801.075039:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909696 00000100:00100000:0.0:1787781801.075052:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781801.075059:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962909440:12345-0@lo:400: 00000100:00100000:0.0:1787781801.075106:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962909440:12345-0@lo:400: Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.075112:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781801.075125:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781801.075130:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962909696:12345-0@lo:400: 00000100:00100000:0.0:1787781801.075159:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962909696:12345-0@lo:400: Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.075164:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781801.075174:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781801.075178:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962909312:12345-0@lo:38: 00010000:00080000:0.0:1787781801.075196:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1787781801.075222:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6d6745c150630f6 00000004:00100000:0.0:1787781801.075235:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787781801.075271:0:6531:0:(import.c:65:import_set_state_nolock()) ffff993c41fab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781801.075308:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874624962909312:12345-0@lo:38: Request processed in 127us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.075314:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781801.075335:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909568 00000100:00100000:0.0:1787781801.075338:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909568 00000100:00100000:0.0:1787781801.075358:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909824 00000100:00100000:0.0:1787781801.075360:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909824 00000100:00100000:0.0:1787781801.075371:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781801.075376:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962909568:12345-0@lo:400: 00000100:00100000:0.0:1787781801.075404:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962909568:12345-0@lo:400: Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.075410:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781801.075421:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781801.075441:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962909824:12345-0@lo:400: 00000100:00100000:0.0:1787781801.075481:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962909824:12345-0@lo:400: Request processed in 54us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781801.075487:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781801.075760:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962909824:0@lo:400: 00010000:00080000:0.0:1787781801.075777:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0e8b40 x1874624962909696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781801.075788:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962909696:0@lo:400: 00010000:00080000:0.0:1787781801.075882:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44000 x1874624962909312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781801.075891:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787781801.075897:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787781801.075910:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787781801.075914:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787781801.075918:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787781801.075924:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624962909312:0@lo:38: 00010000:00080000:0.0:1787781801.075950:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0eb0c0 x1874624962909440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781801.075959:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962909440:0@lo:400: 00000100:00100000:0.0:1787781801.075968:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962909568:0@lo:400: 00000020:01000004:1.0:1787781801.076663:0:8466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787781801.076678:0:8466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff993d67c44d28) 00000020:00000080:1.0:1787781801.076698:0:8466:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1787781801.076772:0:8466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7236f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787781801.076776:0:8466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7236f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787781801.076778:0:8466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7236f800 3 00010000:00080000:1.0:1787781801.076805:0:8466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c41cc1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787781801.079033:0:8466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787781801.079251:0:8466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787781801.079296:0:8466:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787781801.079308:0:8466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc6d6745c15063104 00000100:00080000:1.0:1787781801.079318:0:8466:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787781801.079324:0:8466:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff993c41cc1000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787781801.079356:0:8466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d4c0e8780 x1874624962909952/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787781801.081363:0:8466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787781801.081704:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624962909952:0@lo:38: 00000100:00100000:0.0:1787781801.081781:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.085679:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962909952 00000100:00100000:1.0:1787781801.085692:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962909952 00000100:00100000:1.0:1787781801.085744:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781801.085753:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962909952:12345-0@lo:38: 00010000:00080000:1.0:1787781801.085782:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1787781801.085842:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc6d6745c1506310b 00000004:00100000:1.0:1787781801.085859:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787781801.085892:0:6531:0:(import.c:65:import_set_state_nolock()) ffff993c41cc4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781801.085972:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874624962909952:12345-0@lo:38: Request processed in 218us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.085991:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1787781801.086107:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:0.0:1787781801.086210:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0e8780 x1874624962909952/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781801.086221:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787781801.086228:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787781801.086235:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787781801.086239:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787781801.086242:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c41cc1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787781801.086247:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624962909952:0@lo:38: 00000020:01000000:3.0:1787781801.087654:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787781801.087692:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787781801.087713:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781801.087724:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787781801.087785:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787781801.087787:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781801.087788:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781801.087790:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781801.087791:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781801.087793:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781801.087794:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781801.087795:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781801.087797:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781801.087798:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781801.087811:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787781801.087816:0:8438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787781801.087818:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781801.087820:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781801.087821:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781801.087822:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781801.087823:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781801.087824:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781801.087825:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781801.087826:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781801.087828:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781801.087829:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781801.087830:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787781801.087853:0:8438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787781801.087870:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962910080:0@lo:253: 00000100:00100000:3.0:1787781801.087931:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781801.087967:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.088749:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910080 00000100:00100000:1.0:1787781801.088759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910080 00000100:00100000:1.0:1787781801.090053:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787781801.090071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962910080:12345-0@lo:253: 20000000:01000000:1.0:1787781801.090102:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787781801.090114:0:6525:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787781801.101303:0:6525:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787781801.101324:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787781801.101475:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787781801.101481:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787781801.101503:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781801.101905:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:8438:x1874624962910080:12345-0@lo:253: Request processed in 11837us (13969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.101916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787781801.101989:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8438:1874624962910080:0@lo:253: 10000000:01000000:3.0:1787781801.102002:0:8438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787781801.102005:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787781801.102007:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781801.102009:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781801.102010:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781801.102011:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781801.102012:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781801.102021:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781801.102023:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781801.102024:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781801.102026:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781801.102027:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787781801.102041:0:8438:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787781801.102660:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.102669:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506301d expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.102678:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.102715:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.102730:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 15 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.102744:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d46940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962910208:0@lo:104: 00000100:00100000:2.0:1787781801.102788:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781801.102831:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.102840:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781801.102848:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962910336:0@lo:104: 00000100:00100000:2.0:1787781801.102866:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d467eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781801.102941:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787781801.102961:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.102999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910208 00000100:00100000:1.0:1787781801.103005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910208 00000100:00100000:1.0:1787781801.103036:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910336 00000100:00100000:1.0:1787781801.103039:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910336 00000100:00100000:1.0:1787781801.103050:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781801.103057:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962910208:12345-0@lo:104: 00010000:00010000:1.0:1787781801.103069:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103124:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781801.103130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962910208:12345-0@lo:104: Request processed in 73us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.103136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781801.103170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781801.103175:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962910336:12345-0@lo:104: 00010000:00010000:1.0:1787781801.103182:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103227:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787781801.103232:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962910336:12345-0@lo:104: Request processed in 57us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.103237:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787781801.103254:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781801.103259:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103266:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40031a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781801.103270:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103278:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781801.103285:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781801.103290:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781801.103318:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103324:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781801.103342:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103349:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d40031a00/0xc6d6745c1506301d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063024 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103372:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781801.103375:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103381:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030400 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781801.103384:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103391:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781801.103397:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781801.103402:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781801.103417:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103423:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781801.103428:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103435:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d40030400/0xc6d6745c15063001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063008 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.103448:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781801.103450:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781801.103452:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781801.103470:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962910464:0@lo:103: 00000100:00100000:1.0:1787781801.103504:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.103525:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781801.103531:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962910592:0@lo:103: 00000100:00100000:1.0:1787781801.103552:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781801.103584:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d46940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962910208:0@lo:104: 00000100:00100000:1.0:1787781801.103593:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962910336:0@lo:104: 00010000:00010000:1.0:1787781801.103633:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781801.104738:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781801.104812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910464 00000100:00100000:1.0:1787781801.104820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910464 00010000:00010000:1.0:1787781801.104851:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 16 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781801.104884:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910592 00000100:00100000:1.0:1787781801.104887:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910592 00010000:00010000:1.0:1787781801.104899:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 17 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781801.104913:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781801.104920:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:3657:x1874624962910464:12345-0@lo:103: 00010000:00010000:1.0:1787781801.104933:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781801.104938:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 17 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.104949:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 17 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.104963:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d40030000/0xc6d6745c15063024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506301d expref: 17 pid: 6523 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.104998:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781801.105047:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3657:x1874624962910464:12345-0@lo:103: Request processed in 128us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.105055:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781801.105070:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781801.105077:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3657:x1874624962910592:12345-0@lo:103: 00010000:00010000:1.0:1787781801.105085:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781801.105089:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105097:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105106:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063001 expref: 15 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105117:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105124:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787781801.105137:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010730873s 00010000:00010000:1.0:1787781801.105143:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105150:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105166:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105173:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105179:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41480c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781801.105183:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105192:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105206:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105216:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781801.105241:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3657:x1874624962910592:12345-0@lo:103: Request processed in 164us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781801.105247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781801.105280:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962910592:0@lo:103: 00000100:00100000:1.0:1787781801.105289:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962910464:0@lo:103: 00010000:00010000:1.0:1787781801.105313:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105321:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781801.105328:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480c00/0xc6d6745c15063112 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787781801.112320:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787781801.113523:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787781801.114242:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787781801.114408:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787781801.116163:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787781801.116401:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787781801.118421:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787781801.130342:0:8438:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787781801.130353:0:8438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787781801.130392:0:8438:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787781801.130435:0:8438:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787781801.130458:0:8438:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787781801.130494:0:8438:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787781801.131500:0:8438:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781801.131737:0:8438:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:3.0:1787781801.969296:0:8522:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787781801.969713:0:8522:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787781802.059233:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781802.501797:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781802.501822:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962910720:0@lo:41: 00000100:00100000:1.0:1787781802.501887:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781802.507183:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910720 00000100:00100000:0.0:1787781802.507198:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910720 00000100:00100000:0.0:1787781802.507272:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781802.507283:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962910720:12345-0@lo:41: 00000004:00000024:0.0:1787781802.507319:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787781802.507401:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962910720:12345-0@lo:41: Request processed in 121us (5514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781802.507413:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781802.507460:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962910720:0@lo:41: 00010000:00010000:3.0:1787781803.087201:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787781803.470074:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787781803.470081:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d80a11800 from 30 10000000:01000000:3.0:1787781803.470087:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781803.470181:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.470193:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.470204:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.470226:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962910848:0@lo:101: 00000100:00100000:3.0:1787781803.470288:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.470336:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.470361:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910848 00000100:00100000:3.0:1787781803.470375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910848 00000100:00100000:3.0:1787781803.470422:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787781803.470430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:6528:x1874624962910848:12345-0@lo:101: 00010000:00010000:3.0:1787781803.470442:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781803.470454:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063119 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.470476:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063119 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.470486:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063119 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.470494:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e600, rc 0) 00000100:00100000:3.0:1787781803.470738:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962910848:12345-0@lo:101: Request processed in 308us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.470745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787781803.470926:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962910848:0@lo:101: 00010000:00010000:1.0:1787781803.470942:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.470951:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.471025:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962910976:0@lo:501: 00000100:00100000:1.0:1787781803.471056:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.471090:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.471284:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962910976 00000100:00100000:3.0:1787781803.471290:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962910976 00000100:00100000:3.0:1787781803.471321:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787781803.471329:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962910976:12345-0@lo:501: 00000100:00100000:3.0:1787781803.471457:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962910976:12345-0@lo:501: Request processed in 129us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.471464:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787781803.471541:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962910976:0@lo:501: 00000100:00100000:2.0:1787781803.471572:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911104:0@lo:503: 00000100:00100000:2.0:1787781803.471646:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.471663:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.471775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911104 00000100:00100000:3.0:1787781803.471779:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911104 00000100:00100000:3.0:1787781803.471809:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787781803.471816:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962911104:12345-0@lo:503: 00000100:00100000:3.0:1787781803.471893:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962911104:12345-0@lo:503: Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.471905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787781803.472075:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911104:0@lo:503: 00000100:00100000:2.0:1787781803.475809:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8622:1874624962911232:0@lo:502: 00000100:00100000:2.0:1787781803.475884:0:8622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.475980:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238900 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.480112:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911232 00000100:00100000:3.0:1787781803.480136:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911232 00000100:00100000:3.0:1787781803.480195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787781803.480206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8622:x1874624962911232:12345-0@lo:502: 00000100:00100000:3.0:1787781803.480375:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8622:x1874624962911232:12345-0@lo:502: Request processed in 172us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.480383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787781803.480859:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8622:1874624962911232:0@lo:502: 00000100:00100000:2.0:1787781803.481747:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8622:1874624962911360:0@lo:502: 00000100:00100000:2.0:1787781803.481809:0:8622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.482646:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.484532:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911360 00000100:00100000:0.0:1787781803.484545:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911360 00000100:00100000:0.0:1787781803.484601:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787781803.484628:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8622:x1874624962911360:12345-0@lo:502: 00000100:00100000:0.0:1787781803.484782:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:8622:x1874624962911360:12345-0@lo:502: Request processed in 156us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.484790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787781803.485147:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8622:1874624962911360:0@lo:502: 00000040:00080000:2.0:1787781803.485181:0:8622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787781803.486502:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787781803.486541:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787781803.486553:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.486564:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781803.486575:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787781803.486578:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d80a11800 from 5 10000000:01000000:3.0:1787781803.486581:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787781803.486633:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.486641:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.486651:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.486670:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911488:0@lo:101: 00000100:00100000:3.0:1787781803.486732:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.486768:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.486875:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911488 00000100:00100000:0.0:1787781803.486881:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911488 00000100:00100000:0.0:1787781803.486935:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787781803.486944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962911488:12345-0@lo:101: 00010000:00010000:0.0:1787781803.486956:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781803.486981:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063127 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781803.487004:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781803.487013:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781803.487021:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9000, rc 0) 00000100:00100000:0.0:1787781803.487056:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962911488:12345-0@lo:101: Request processed in 114us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.487062:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787781803.487431:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911488:0@lo:101: 00010000:00010000:3.0:1787781803.487445:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.487455:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.487504:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911616:0@lo:256: 00000100:00100000:3.0:1787781803.487596:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.487647:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.487695:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911616 00000100:00100000:1.0:1787781803.487699:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911616 00000100:00100000:1.0:1787781803.487732:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787781803.487740:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962911616:12345-0@lo:256: 20000000:01000000:1.0:1787781803.487752:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787781803.487767:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787781803.487775:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787781803.487853:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962911616:12345-0@lo:256: Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.487861:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787781803.488047:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911616:0@lo:256: 10000000:01000000:3.0:1787781803.488095:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787781803.488102:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.488109:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781803.488117:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787781803.488119:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787781803.488121:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787781803.488631:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.488639:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.488660:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.488675:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911744:0@lo:101: 00000100:00100000:3.0:1787781803.488708:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.488735:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.489098:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911744 00000100:00100000:1.0:1787781803.489105:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911744 00000100:00100000:1.0:1787781803.489217:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787781803.489226:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962911744:12345-0@lo:101: 00010000:00010000:1.0:1787781803.489237:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781803.489251:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063135 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.489271:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063135 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.489280:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063135 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.489289:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038000, rc 0) 00000100:00100000:1.0:1787781803.489323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962911744:12345-0@lo:101: Request processed in 98us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.489330:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787781803.489509:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911744:0@lo:101: 00010000:00010000:3.0:1787781803.489598:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.489645:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.489701:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911872:0@lo:501: 00000100:00100000:3.0:1787781803.489729:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.489754:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781803.491237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962911872 00000100:00100000:2.0:1787781803.491248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962911872 00000100:00100000:2.0:1787781803.491297:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787781803.491305:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962911872:12345-0@lo:501: 00000100:00100000:2.0:1787781803.491443:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962911872:12345-0@lo:501: Request processed in 138us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.491451:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787781803.491751:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962911872:0@lo:501: 00000100:00100000:3.0:1787781803.491797:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962912000:0@lo:503: 00000100:00100000:3.0:1787781803.491846:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.491875:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781803.492222:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912000 00000100:00100000:2.0:1787781803.492227:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912000 00000100:00100000:2.0:1787781803.492261:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787781803.492268:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962912000:12345-0@lo:503: 00000100:00100000:2.0:1787781803.492353:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962912000:12345-0@lo:503: Request processed in 85us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.492369:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787781803.493085:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962912000:0@lo:503: 00000100:00100000:3.0:1787781803.494420:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8624:1874624962912128:0@lo:502: 00000100:00100000:3.0:1787781803.494492:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.494822:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.494972:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912128 00000100:00100000:0.0:1787781803.494979:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912128 00000100:00100000:0.0:1787781803.495026:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787781803.495034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8624:x1874624962912128:12345-0@lo:502: 00000100:00100000:0.0:1787781803.495162:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8624:x1874624962912128:12345-0@lo:502: Request processed in 128us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.495169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787781803.495311:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8624:1874624962912128:0@lo:502: 00000020:01000000:3.0:1787781803.495343:0:8624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787781803.495351:0:8624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787781803.495357:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781803.495359:0:8624:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787781803.495363:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787781803.495366:0:8624:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:3.0:1787781803.495387:0:8624:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787781803.495390:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781803.495404:0:8624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff993d770db370) 00000020:00000080:3.0:1787781803.495423:0:8624:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787781803.495428:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787781803.495496:0:8624:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787781803.495502:0:8624:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787781803.495508:0:8624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c1506314a 00010000:00080000:3.0:1787781803.495544:0:8624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c426a9000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787781803.495816:0:8624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787781803.514118:0:8624:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787781803.514151:0:8624:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787781803.514369:0:8624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781803.514578:0:8624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781803.514725:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787781803.514813:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787781803.515751:0:8627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781803.515756:0:8627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787781803.517113:0:8624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787781803.517277:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787781803.517317:0:8624:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787781803.517339:0:8624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15063151 00000100:00080000:3.0:1787781803.517349:0:8624:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781803.517355:0:8624:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff993c426a9000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787781803.517388:0:8624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d4beab0c0 x1874624962912256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787781803.517415:0:8624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787781803.517488:0:8624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781803.517492:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781803.517498:0:8624:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787781803.517502:0:8624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781803.517505:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781803.517507:0:8624:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787781803.517510:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:0.0:1787781803.518092:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962912256:0@lo:8: 00000100:00100000:0.0:1787781803.518226:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781803.518286:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912256 00000100:00100000:0.0:1787781803.518292:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912256 00000100:00100000:0.0:1787781803.518319:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781803.518325:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624962912256:12345-0@lo:8: 00010000:00080000:0.0:1787781803.518351:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1787781803.518377:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15063158 00002000:00100000:0.0:1787781803.518412:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff993c41faa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787781803.518417:0:8445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787781803.518421:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787781803.518478:0:8445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787781803.518715:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787781803.518739:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c41fae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781803.518788:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624962912256:12345-0@lo:8: Request processed in 461us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.518801:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787781803.518838:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4beab0c0 x1874624962912256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781803.518849:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787781803.518856:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787781803.518863:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787781803.518866:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787781803.518869:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c426a9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787781803.518880:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787781803.518885:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962912256:0@lo:8: 00000100:00100000:0.0:1787781803.518937:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962912384:0@lo:700: 00000020:00000080:3.0:1787781803.519065:0:8624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787781803.519091:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8624:1874624962912512:0@lo:502: 00000100:00100000:1.0:1787781803.519323:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962912640:0@lo:400: 00000100:00100000:1.0:1787781803.519354:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519377:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962913152:0@lo:400: 00000100:00100000:1.0:1787781803.519400:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519416:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781803.519422:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962913024:0@lo:400: 00000100:00100000:1.0:1787781803.519454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519481:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962912768:0@lo:400: 00000100:00100000:1.0:1787781803.519515:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519535:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962913280:0@lo:400: 00000100:00100000:1.0:1787781803.519556:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519573:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781803.519578:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962912896:0@lo:400: 00000100:00100000:1.0:1787781803.519597:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.519651:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912640 00000100:00100000:1.0:1787781803.519656:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912640 00000100:00100000:1.0:1787781803.519680:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913152 00000100:00100000:1.0:1787781803.519683:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913152 00000100:00100000:1.0:1787781803.519701:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913280 00000100:00100000:1.0:1787781803.519704:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913280 00000100:00100000:1.0:1787781803.519715:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912896 00000100:00100000:1.0:1787781803.519717:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912896 00000100:00100000:1.0:1787781803.519730:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781803.519737:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962912640:12345-0@lo:400: 00000100:00100000:1.0:1787781803.519776:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962912640:12345-0@lo:400: Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.519783:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781803.519798:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781803.519804:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962913152:12345-0@lo:400: 00000100:00100000:1.0:1787781803.519831:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962913152:12345-0@lo:400: Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.519837:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781803.519848:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781803.519854:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962913280:12345-0@lo:400: 00000100:00100000:1.0:1787781803.519891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962913280:12345-0@lo:400: Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.519897:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781803.519910:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787781803.519915:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962912896:12345-0@lo:400: 00000100:00100000:1.0:1787781803.519938:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962912896:12345-0@lo:400: Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.519944:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787781803.520284:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.520310:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.520332:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912512 00000100:00100000:3.0:1787781803.520335:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912512 00000100:00100000:3.0:1787781803.520370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787781803.520377:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8624:x1874624962912512:12345-0@lo:502: 00000100:00100000:3.0:1787781803.520477:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:8624:x1874624962912512:12345-0@lo:502: Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.520484:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787781803.520527:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8624:1874624962912512:0@lo:502: 00000020:01000000:3.0:1787781803.520552:0:8624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781803.520559:0:8624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781803.520561:0:8624:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787781803.520565:0:8624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787781803.520683:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787781803.520699:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787781803.520708:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520718:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781803.520728:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787781803.520736:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d47267800 from 30 10000000:01000000:3.0:1787781803.520739:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781803.520764:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520772:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520781:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781803.520793:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913408:0@lo:101: 00000100:00100000:3.0:1787781803.520819:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.520844:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.520857:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913408 00000100:00100000:3.0:1787781803.520860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913408 00000100:00100000:3.0:1787781803.520880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787781803.520886:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962913408:12345-0@lo:101: 00010000:00010000:3.0:1787781803.520894:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781803.520907:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506315f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520926:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506315f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520936:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506315f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.520945:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166a00, rc 0) 00000100:00100000:1.0:1787781803.522060:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913024 00000100:00100000:1.0:1787781803.522070:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913024 00000100:00100000:1.0:1787781803.522109:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912768 00000100:00100000:1.0:1787781803.522113:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912768 00000100:00100000:0.0:1787781803.522219:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781803.522263:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.522310:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781803.522319:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962913024:12345-0@lo:400: 00000100:00100000:1.0:1787781803.522374:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962913024:12345-0@lo:400: Request processed in 57us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.522382:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781803.522397:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787781803.522403:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962912768:12345-0@lo:400: 00000100:00100000:1.0:1787781803.522430:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962912768:12345-0@lo:400: Request processed in 28us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.522436:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787781803.522477:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781803.522483:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781803.522510:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962913024:0@lo:400: 00010000:00080000:1.0:1787781803.522526:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0eb480 x1874624962912640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.522551:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962912640:0@lo:400: 00010000:00080000:1.0:1787781803.522564:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d506ef480 x1874624962913152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.522572:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962913152:0@lo:400: 00010000:00080000:1.0:1787781803.522632:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0ea1c0 x1874624962912896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.522642:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962912896:0@lo:400: 00000100:00100000:1.0:1787781803.522654:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962912768:0@lo:400: 00010000:00080000:1.0:1787781803.522664:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d506eda40 x1874624962913280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.522672:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962913280:0@lo:400: 00000100:00100000:1.0:1787781803.522703:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962912384 00000100:00100000:1.0:1787781803.522707:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962912384 00000100:00100000:1.0:1787781803.522747:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781803.522754:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8628:x1874624962912384:12345-0@lo:700: 00000100:00100000:1.0:1787781803.522791:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8453:1874624962913536:0@lo:700: 00000100:00100000:1.0:1787781803.522821:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.522837:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.522853:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913536 00000100:00100000:1.0:1787781803.522856:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913536 00000100:00100000:1.0:1787781803.522879:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781803.522885:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8453:x1874624962913536:12345-0@lo:700: 00000100:00080000:0.0:1787781803.523246:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781803.523403:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962913408:12345-0@lo:101: Request processed in 2513us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.523419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:3.0:1787781803.524079:0:8627:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787781803.524219:0:8627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 240605610890ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787781803.524226:0:8627:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787781803.524653:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913408:0@lo:101: 00010000:00010000:0.0:1787781803.524676:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781803.524689:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781803.524758:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913664:0@lo:501: 00000100:00100000:0.0:1787781803.524802:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781803.524831:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.524853:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913664 00000100:00100000:0.0:1787781803.524857:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913664 00000100:00100000:0.0:1787781803.524899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787781803.524906:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962913664:12345-0@lo:501: 00000100:00100000:0.0:1787781803.527257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962913664:12345-0@lo:501: Request processed in 2343us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.527270:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:3.0:1787781803.528783:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787781803.532496:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913664:0@lo:501: 00000100:00100000:0.0:1787781803.532739:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913792:0@lo:503: 00000100:00100000:0.0:1787781803.532810:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781803.532844:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d490663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.532904:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913792 00000100:00100000:1.0:1787781803.532909:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913792 00000100:00100000:1.0:1787781803.532958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787781803.533436:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962913792:12345-0@lo:503: 00000100:00100000:1.0:1787781803.533568:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962913792:12345-0@lo:503: Request processed in 135us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.533643:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962913792:0@lo:503: 00000100:00100000:3.0:1787781803.533830:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8629:1874624962913920:0@lo:502: 00000100:00100000:3.0:1787781803.533867:0:8629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.533891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962913920 00000100:00100000:3.0:1787781803.533895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962913920 00000100:00100000:1.0:1787781803.537494:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781803.537712:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.539937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787781803.539956:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8629:x1874624962913920:12345-0@lo:502: 00000100:00100000:3.0:1787781803.540145:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8629:x1874624962913920:12345-0@lo:502: Request processed in 195us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.540152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787781803.540215:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8629:1874624962913920:0@lo:502: 00000100:00100000:3.0:1787781803.540276:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8629:1874624962914048:0@lo:502: 00000100:00100000:3.0:1787781803.540317:0:8629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.540340:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.540689:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914048 00000100:00100000:1.0:1787781803.540695:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914048 00000100:00100000:1.0:1787781803.540727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787781803.540734:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8629:x1874624962914048:12345-0@lo:502: 00000100:00100000:1.0:1787781803.540819:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:8629:x1874624962914048:12345-0@lo:502: Request processed in 85us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.540825:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787781803.542289:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8629:1874624962914048:0@lo:502: 00000040:00080000:3.0:1787781803.542323:0:8629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787781803.542459:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787781803.542482:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787781803.542492:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.542503:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781803.542580:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787781803.542584:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d47267800 from 5 10000000:01000000:1.0:1787781803.542587:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787781803.542644:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.542653:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.542670:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.542686:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914176:0@lo:101: 00000100:00100000:1.0:1787781803.542745:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.542777:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.543070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914176 00000100:00100000:3.0:1787781803.543077:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914176 00000100:00100000:3.0:1787781803.543121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787781803.544240:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962914176:12345-0@lo:101: 00010000:00010000:3.0:1787781803.544262:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781803.544277:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506316d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.544301:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506316d expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.544312:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506316d expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781803.544321:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166200, rc 0) 00000100:00100000:3.0:1787781803.544378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962914176:12345-0@lo:101: Request processed in 144us (1632us total) trans 0 rc 0/0 40000000:02000000:0.0:1787781803.546722:0:6539:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1787781803.549836:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914176:0@lo:101: 00010000:00010000:1.0:1787781803.549863:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.549876:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.549953:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914304:0@lo:256: 00000100:00100000:1.0:1787781803.550072:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.550112:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.550193:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914304 00000100:00100000:1.0:1787781803.550199:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914304 00000100:00100000:1.0:1787781803.550235:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781803.550243:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914304:12345-0@lo:256: 20000000:01000000:1.0:1787781803.550260:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787781803.550275:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787781803.550279:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787781803.550360:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914304:12345-0@lo:256: Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.550368:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781803.550410:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914304:0@lo:256: 10000000:01000000:1.0:1787781803.550448:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787781803.550455:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550463:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781803.550472:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787781803.550475:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787781803.550478:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787781803.550498:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550505:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550514:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.550525:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914432:0@lo:101: 00000100:00100000:1.0:1787781803.550548:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.550560:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.550570:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914432 00000100:00100000:1.0:1787781803.550573:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914432 00000100:00100000:1.0:1787781803.550589:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787781803.550594:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914432:12345-0@lo:101: 00010000:00010000:1.0:1787781803.550602:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781803.550639:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506317b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550663:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506317b expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550672:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506317b expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550680:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038400, rc 0) 00000100:00100000:1.0:1787781803.550707:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962914432:12345-0@lo:101: Request processed in 111us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.550713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787781803.550739:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914432:0@lo:101: 00010000:00010000:1.0:1787781803.550749:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.550756:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.550803:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914560:0@lo:501: 00000100:00100000:1.0:1787781803.550826:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.550838:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.550849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914560 00000100:00100000:1.0:1787781803.550852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914560 00000100:00100000:1.0:1787781803.550868:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787781803.550874:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962914560:12345-0@lo:501: 00000100:00100000:3.0:1787781803.551081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787781803.552111:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914560:12345-0@lo:501: Request processed in 1234us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.552203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787781803.552258:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914560:0@lo:501: 00000100:00100000:1.0:1787781803.552295:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914688:0@lo:503: 00000100:00100000:1.0:1787781803.552340:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.552365:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.552380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914688 00000100:00100000:1.0:1787781803.552385:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914688 00000100:00100000:1.0:1787781803.552414:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787781803.552422:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914688:12345-0@lo:503: 00000100:00100000:1.0:1787781803.552527:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962914688:12345-0@lo:503: Request processed in 105us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.552535:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787781803.552574:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962914688:0@lo:503: 00000100:00100000:0.0:1787781803.556733:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8453:x1874624962913536:12345-0@lo:700: Request processed in 33838us (33902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.556746:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787781803.556882:0:8453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fe0f00 x1874624962913536/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.556897:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8453:1874624962913536:0@lo:700: 40000000:02000000:1.0:1787781803.556910:0:8453:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1787781803.561765:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8632:1874624962914816:0@lo:502: 00000100:00100000:3.0:1787781803.561846:0:8632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.561881:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.561950:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914816 00000100:00100000:0.0:1787781803.561956:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914816 00000100:00100000:0.0:1787781803.562017:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787781803.562026:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:8632:x1874624962914816:12345-0@lo:502: 00000100:00100000:0.0:1787781803.562279:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:8632:x1874624962914816:12345-0@lo:502: Request processed in 253us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.562288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787781803.562388:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8632:1874624962914816:0@lo:502: 00000020:01000000:3.0:1787781803.562416:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787781803.562423:0:8632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787781803.562428:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781803.562430:0:8632:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787781803.562435:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787781803.562438:0:8632:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:3.0:1787781803.562459:0:8632:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787781803.562462:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781803.562475:0:8632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff993d770dcd28) 00000020:00000080:3.0:1787781803.562494:0:8632:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787781803.562504:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787781803.562569:0:8632:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787781803.562573:0:8632:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787781803.562578:0:8632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15063190 00010000:00080000:3.0:1787781803.562653:0:8632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d7c44c800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787781803.562863:0:8632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1787781803.572320:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787781803.577620:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962912384:12345-0@lo:700: Request processed in 54844us (58633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781803.577639:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787781803.579467:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67f1fc00 x1874624962912384/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.579484:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962912384:0@lo:700: 00000040:01000000:0.0:1787781803.581366:0:8632:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787781803.581387:0:8632:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787781803.581665:0:8632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781803.581861:0:8632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781803.582266:0:8632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787781803.582374:0:8632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787781803.582718:0:8635:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781803.582722:0:8635:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787781803.585217:0:8632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787781803.585230:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787781803.585271:0:8632:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787781803.585294:0:8632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15063197 00000100:00080000:2.0:1787781803.585304:0:8632:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781803.585310:0:8632:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff993d7c44c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787781803.585341:0:8632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c41d44780 x1874624962914944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781803.585368:0:8632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787781803.585426:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781803.585430:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781803.585432:0:8632:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787781803.585435:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781803.585439:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781803.585440:0:8632:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787781803.585443:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787781803.585445:0:8632:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787781803.585470:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8632:1874624962915072:0@lo:502: 00000100:00100000:2.0:1787781803.585708:0:8632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.585781:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962914944:0@lo:8: 00000100:00100000:1.0:1787781803.585818:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.585898:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962914944 00000100:00100000:1.0:1787781803.585905:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962914944 00000100:00100000:1.0:1787781803.585935:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781803.585942:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1874624962914944:12345-0@lo:8: 00010000:00080000:1.0:1787781803.585985:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1787781803.586009:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c1506319e 00002000:00100000:1.0:1787781803.586021:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff993c41cc0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787781803.586025:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787781803.586028:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787781803.586113:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1787781803.586257:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad70c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787781803.586311:0:8447:0:(import.c:65:import_set_state_nolock()) ffff993c41cc6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781803.586365:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624962914944:12345-0@lo:8: Request processed in 422us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.586373:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787781803.586827:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44780 x1874624962914944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.586836:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787781803.586843:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787781803.586850:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787781803.586854:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787781803.586857:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d7c44c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787781803.586880:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787781803.586886:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962914944:0@lo:8: 00000004:00080000:2.0:1787781803.586910:0:8635:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787781803.586973:0:8635:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240668352962ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787781803.586980:0:8635:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787781803.591414:0:8628:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787781803.591443:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962915328:0@lo:7: 00000100:00100000:2.0:1787781803.591506:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.591549:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.591685:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962915200:0@lo:13: 00000100:00100000:1.0:1787781803.591715:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.591765:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915328 00000100:00100000:1.0:1787781803.591771:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915328 00000100:00100000:1.0:1787781803.591811:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781803.591819:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962915328:12345-0@lo:7: 00000100:00100000:2.0:1787781803.592269:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915200 00000100:00100000:2.0:1787781803.592274:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915200 00000100:00100000:2.0:1787781803.592301:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781803.592308:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962915200:12345-0@lo:13: 00002000:00000024:2.0:1787781803.592323:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1787781803.592370:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962915200:12345-0@lo:13: Request processed in 61us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.592376:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787781803.592443:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787781803.594719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915072 00000100:00100000:3.0:1787781803.594729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915072 00000100:00100000:2.0:1787781803.594845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787781803.594854:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:8632:x1874624962915072:12345-0@lo:502: 00000100:00100000:2.0:1787781803.595027:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:8632:x1874624962915072:12345-0@lo:502: Request processed in 173us (9318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.595035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787781803.595089:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:8632:1874624962915072:0@lo:502: 00000020:01000000:2.0:1787781803.595120:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781803.595248:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781803.595250:0:8632:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787781803.595259:0:8632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:3.0:1787781803.605200:0:8636:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787781803.605235:0:8636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962915584:0@lo:7: 00000100:00100000:3.0:1787781803.605327:0:8636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781803.605354:0:8636:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781803.608002:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962915456:0@lo:13: 00000100:00100000:2.0:1787781803.608066:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.608305:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915456 00000100:00100000:2.0:1787781803.608311:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915456 00000100:00100000:2.0:1787781803.608353:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781803.608372:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624962915456:12345-0@lo:13: 00002000:00000024:2.0:1787781803.608393:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1787781803.608436:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624962915456:12345-0@lo:13: Request processed in 65us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.608443:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787781803.608481:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4bea8000 x1874624962915456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.608498:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962915456:0@lo:13: 00000020:01000000:1.0:1787781803.609106:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787781803.609324:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787781803.609335:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.609345:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781803.609356:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787781803.609358:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993d588099b8 from 1 10000000:01000000:1.0:1787781803.609361:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781803.609398:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.609405:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.609414:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.609429:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962915712:0@lo:101: 00000100:00100000:1.0:1787781803.609473:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.609507:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.609538:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787781803.609544:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787781803.609679:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915712 00000100:00100000:2.0:1787781803.609685:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915712 00000100:00100000:2.0:1787781803.609718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787781803.609726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962915712:12345-0@lo:101: 00010000:00010000:2.0:1787781803.609735:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781803.609749:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150631a5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781803.609770:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781803.609780:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781803.609799:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480600, rc 0) 00000100:00100000:2.0:1787781803.609831:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962915712:12345-0@lo:101: Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781803.609838:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787781803.611244:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962915712:0@lo:101: 00010000:00010000:1.0:1787781803.611270:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.611281:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.611345:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962915840:0@lo:501: 00000100:00100000:1.0:1787781803.611384:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781803.611425:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781803.612072:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915840 00000100:00100000:2.0:1787781803.612080:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915840 00000100:00100000:2.0:1787781803.612118:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787781803.612203:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962915840:12345-0@lo:501: 00000100:00100000:2.0:1787781803.612291:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962915840:12345-0@lo:501: Request processed in 91us (905us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781803.612299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787781803.612702:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781803.613071:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962915840:0@lo:501: 10000000:01000000:1.0:1787781803.613107:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787781803.613116:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781803.613592:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781803.613648:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915584 00000100:00100000:1.0:1787781803.613654:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915584 00010000:00080000:1.0:1787781803.613703:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44780 x1874624962915200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781803.613721:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962915200:0@lo:13: 00002000:00080000:1.0:1787781803.620625:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787781803.620640:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787781803.620731:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962915328:12345-0@lo:7: Request processed in 28908us (29221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.620743:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781803.620776:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781803.620789:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8636:x1874624962915584:12345-0@lo:7: 00010000:00080000:2.0:1787781803.628602:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44f00 x1874624962915328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.628640:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962915328:0@lo:7: 00000004:00080000:2.0:1787781803.628657:0:8628:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787781803.628696:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962915968:0@lo:5: 00000100:00100000:2.0:1787781803.628752:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.628800:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787781803.628809:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962915968 00000100:00100000:2.0:1787781803.628814:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962915968 00000100:00100000:2.0:1787781803.628868:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238300 going to sleep for 11 seconds 00002000:00080000:1.0:1787781803.640862:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787781803.640870:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787781803.640957:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8636:x1874624962915584:12345-0@lo:7: Request processed in 20170us (35627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.640980:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781803.641009:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781803.641020:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962915968:12345-0@lo:5: 00002000:00080000:1.0:1787781803.641047:0:8446:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787781803.641079:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962915968:12345-0@lo:5: Request processed in 62us (12326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.641086:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787781803.641915:0:8636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4beaa940 x1874624962915584/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.641930:0:8636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962915584:0@lo:7: 00000004:00080000:2.0:1787781803.641941:0:8636:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787781803.641998:0:8636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916096:0@lo:5: 00000100:00100000:2.0:1787781803.642033:0:8636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.642057:0:8636:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772383c0 going to sleep for 11 seconds 00010000:00080000:2.0:1787781803.642474:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44f00 x1874624962915968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.642484:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962915968:0@lo:5: 00000004:00080000:2.0:1787781803.642492:0:8628:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787781803.642583:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962916224:0@lo:5: 00000100:00100000:2.0:1787781803.642629:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.642655:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916096 00000100:00100000:2.0:1787781803.642660:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916096 00000100:00100000:2.0:1787781803.642693:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916224 00000100:00100000:2.0:1787781803.642696:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916224 00000100:00100000:2.0:1787781803.642712:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781803.642719:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8636:x1874624962916096:12345-0@lo:5: 00002000:00080000:2.0:1787781803.642739:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787781803.642742:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787781803.643079:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781803.643089:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8628:x1874624962916224:12345-0@lo:5: 00002000:00080000:1.0:1787781803.643109:0:8445:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787781803.650312:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781803.652806:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8628:x1874624962916224:12345-0@lo:5: Request processed in 9714us (10170us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787781803.652818:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787781803.652876:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44f00 x1874624962916224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781803.652891:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8628:1874624962916224:0@lo:5: 00000004:00080000:0.0:1787781803.652905:0:8628:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787781803.652943:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8628:1874624962916352:0@lo:900: 00000100:00100000:0.0:1787781803.655280:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781803.655318:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d10c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781803.655633:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916352 00000100:00100000:3.0:1787781803.655641:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916352 00000100:00100000:3.0:1787781803.655686:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781803.655696:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8628:x1874624962916352:12345-0@lo:900: 00000100:00100000:3.0:1787781803.655756:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8628:x1874624962916352:12345-0@lo:900: Request processed in 61us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781803.655763:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787781803.656072:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67f1e580 x1874624962916352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781803.656086:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8628:1874624962916352:0@lo:900: 00000001:00080000:2.0:1787781803.660776:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1787781803.660792:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787781803.660803:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787781803.660919:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8636:x1874624962916096:12345-0@lo:5: Request processed in 18196us (18881us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787781803.660930:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787781803.662095:0:8636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44b40 x1874624962916096/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.662108:0:8636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787781803.662588:0:8636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916096:0@lo:5: 00000004:00080000:2.0:1787781803.662622:0:8636:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787781803.662672:0:8636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916480:0@lo:700: 00000100:00100000:2.0:1787781803.662722:0:8636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.662822:0:8636:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.667222:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916480 00000100:00100000:1.0:1787781803.667233:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916480 00000100:00100000:1.0:1787781803.667828:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781803.667839:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8636:x1874624962916480:12345-0@lo:700: 00000100:00100000:1.0:1787781803.677424:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8636:x1874624962916480:12345-0@lo:700: Request processed in 9579us (14693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781803.677437:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787781803.677528:0:8636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44b40 x1874624962916480/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781803.677542:0:8636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916480:0@lo:700: 00000004:02000040:0.0:1787781803.679890:0:8636:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787781803.690071:0:8636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916608:0@lo:5: 00000100:00100000:2.0:1787781803.690139:0:8636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781803.690185:0:8636:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781803.690709:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916608 00000100:00100000:1.0:1787781803.690716:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916608 00000100:00100000:1.0:1787781803.690794:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787781803.690804:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8636:x1874624962916608:12345-0@lo:5: 00002000:00080000:0.0:1787781803.696434:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787781803.696453:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787781803.698561:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8636:x1874624962916608:12345-0@lo:5: Request processed in 7752us (8415us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787781803.698573:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787781803.698814:0:8636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d44b40 x1874624962916608/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781803.698830:0:8636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8636:1874624962916608:0@lo:5: 00000004:00080000:0.0:1787781803.698844:0:8636:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1787781804.101890:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781805.130096:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781805.575419:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781805.575444:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962916736:0@lo:41: 00000100:00100000:2.0:1787781805.575518:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781805.575947:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916736 00000100:00100000:1.0:1787781805.575970:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916736 00000100:00100000:1.0:1787781805.576023:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781805.576032:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962916736:12345-0@lo:41: 00000004:00000024:1.0:1787781805.576064:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787781805.576114:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962916736:12345-0@lo:41: Request processed in 83us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781805.576121:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781805.576160:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962916736:0@lo:41: 00010000:00010000:3.0:1787781806.151980:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781806.866028:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787781807.173810:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781807.624295:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962916864:0@lo:41: 00000100:00100000:2.0:1787781807.624361:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781807.624447:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916864 00000100:00100000:2.0:1787781807.624454:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916864 00000100:00100000:2.0:1787781807.624504:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781807.624512:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962916864:12345-0@lo:41: 00000004:00000024:2.0:1787781807.624545:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787781807.624602:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962916864:12345-0@lo:41: Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781807.624635:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781807.624682:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962916864:0@lo:41: 00000020:00000004:1.0:1787781807.796044:0:8873:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781807.796439:0:8873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787781808.197790:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781808.645830:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781808.645851:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962916992:0@lo:13: 00000100:00100000:0.0:1787781808.645923:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781808.646145:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962916992 00000100:00100000:0.0:1787781808.646152:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962916992 00000100:00100000:0.0:1787781808.646254:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781808.646264:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962916992:12345-0@lo:13: 00002000:00000024:0.0:1787781808.646289:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781808.646331:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962916992:12345-0@lo:13: Request processed in 70us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781808.646337:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787781808.646374:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67d43c00 x1874624962916992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781808.646384:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787781808.646402:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962916992:0@lo:13: 00000100:00100000:3.0:1787781808.646741:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962917248:0@lo:400: 00000100:00100000:3.0:1787781808.646776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781808.646797:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962917760:0@lo:400: 00000100:00100000:3.0:1787781808.646836:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781808.646862:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787781808.646868:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962917120:0@lo:400: 00000100:00100000:3.0:1787781808.646894:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781808.646915:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962917632:0@lo:400: 00000100:00100000:3.0:1787781808.646950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781808.646979:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917248 00000100:00100000:3.0:1787781808.646984:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917248 00000100:00100000:3.0:1787781808.647012:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917760 00000100:00100000:3.0:1787781808.647015:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917760 00000100:00100000:0.0:1787781808.647181:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917632 00000100:00100000:0.0:1787781808.647184:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917632 00000100:00100000:0.0:1787781808.647210:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787781808.647218:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962917632:12345-0@lo:400: 00000100:00100000:0.0:1787781808.647258:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962917632:12345-0@lo:400: Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781808.647264:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787781808.647381:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962917376:0@lo:400: 00000100:00100000:0.0:1787781808.647406:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781808.647423:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962917888:0@lo:400: 00000100:00100000:0.0:1787781808.647450:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781808.647464:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781808.647470:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962917504:0@lo:400: 00000100:00100000:0.0:1787781808.647495:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781808.647506:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962918016:0@lo:400: 00000100:00100000:0.0:1787781808.647525:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781808.647551:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917376 00000100:00100000:0.0:1787781808.647556:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917376 00000100:00100000:0.0:1787781808.647578:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787781808.647584:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962917376:12345-0@lo:400: 00000100:00100000:0.0:1787781808.647635:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962917376:12345-0@lo:400: Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781808.647642:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787781808.647670:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962917632:0@lo:400: 00000100:00100000:0.0:1787781808.647693:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962917376:0@lo:400: 00000100:00080000:2.0:1787781808.648097:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781808.648103:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781808.648116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917120 00000100:00100000:2.0:1787781808.648120:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917120 00000100:00100000:2.0:1787781808.648162:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787781808.648179:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962917120:12345-0@lo:400: 00000100:00100000:2.0:1787781808.648218:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962917120:12345-0@lo:400: Request processed in 50us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781808.648225:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787781808.648253:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918016 00000100:00100000:2.0:1787781808.648257:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918016 00000100:00100000:2.0:1787781808.648287:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781808.648293:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624962918016:12345-0@lo:400: 00000100:00100000:2.0:1787781808.648322:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624962918016:12345-0@lo:400: Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781808.648327:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787781808.648363:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781808.648384:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917888 00000100:00100000:2.0:1787781808.648387:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917888 00000100:00100000:2.0:1787781808.648406:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962917504 00000100:00100000:2.0:1787781808.648408:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962917504 00000100:00100000:2.0:1787781808.648419:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787781808.648424:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962917248:12345-0@lo:400: 00000100:00100000:2.0:1787781808.648451:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962917248:12345-0@lo:400: Request processed in 28us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781808.648468:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787781808.648481:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781808.648487:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962917888:12345-0@lo:400: 00000100:00100000:2.0:1787781808.648514:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962917888:12345-0@lo:400: Request processed in 27us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781808.648519:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781808.648529:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781808.648535:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962917504:12345-0@lo:400: 00000100:00100000:2.0:1787781808.648556:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962917504:12345-0@lo:400: Request processed in 22us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781808.648561:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787781808.648573:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781808.648865:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781808.648872:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962917760:12345-0@lo:400: 00000100:00100000:3.0:1787781808.648906:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962917760:12345-0@lo:400: Request processed in 35us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781808.648911:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781808.649052:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962917120:0@lo:400: 00010000:00080000:0.0:1787781808.649067:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4beaa940 x1874624962917248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781808.649302:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962918144:0@lo:13: 00000100:00100000:2.0:1787781808.649335:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781808.649404:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918144 00000100:00100000:3.0:1787781808.649410:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918144 00000100:00100000:3.0:1787781808.649440:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787781808.649446:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624962918144:12345-0@lo:13: 00002000:00000024:3.0:1787781808.649460:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781808.649496:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624962918144:12345-0@lo:13: Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781808.649502:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787781808.649526:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cdbc00 x1874624962918144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781808.649542:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962918144:0@lo:13: 00000100:00100000:0.0:1787781808.650011:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962917248:0@lo:400: 00010000:00080000:0.0:1787781808.650029:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4bea83c0 x1874624962917760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781808.650037:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962917760:0@lo:400: 00010000:00080000:0.0:1787781808.652717:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4bea9a40 x1874624962917504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781808.652736:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962917504:0@lo:400: 00010000:00080000:0.0:1787781808.652756:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4bea9680 x1874624962918016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781808.652857:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962918016:0@lo:400: 00010000:00080000:0.0:1787781808.652879:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4beaad00 x1874624962917888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781808.652888:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962917888:0@lo:400: 00000001:00080000:1.0:1787781808.700977:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787781809.224564:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781810.246794:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787781810.679076:0:8974:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781810.679324:0:8974:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787781810.697651:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781810.697678:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962918272:0@lo:41: 00000100:00100000:3.0:1787781810.697748:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781810.698040:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918272 00000100:00100000:1.0:1787781810.698049:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918272 00000100:00100000:1.0:1787781810.698096:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787781810.698106:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962918272:12345-0@lo:41: 00000004:00000024:1.0:1787781810.698137:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787781810.698184:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962918272:12345-0@lo:41: Request processed in 80us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781810.698191:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787781810.699866:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962918272:0@lo:41: 00010000:00010000:3.0:1787781811.271838:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787781811.664050:0:9023:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781811.664062:0:9023:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787781812.296851:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781812.742044:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781812.742864:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962918400:0@lo:41: 00000100:00100000:3.0:1787781812.743011:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.743330:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918400 00000100:00100000:0.0:1787781812.743339:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918400 00000100:00100000:0.0:1787781812.743394:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787781812.743403:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962918400:12345-0@lo:41: 00000004:00000024:0.0:1787781812.743438:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787781812.743539:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962918400:12345-0@lo:41: Request processed in 137us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.743547:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787781812.745062:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962918400:0@lo:41: 00010000:00010000:3.0:1787781813.323436:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781813.765859:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781813.765892:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962918528:0@lo:13: 00000100:00100000:1.0:1787781813.765969:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.766060:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918528 00000100:00100000:0.0:1787781813.766068:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918528 00000100:00100000:0.0:1787781813.766127:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781813.766137:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962918528:12345-0@lo:13: 00002000:00000024:0.0:1787781813.766163:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781813.766205:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962918528:12345-0@lo:13: Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.766212:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781813.766300:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962918656:0@lo:400: 00000100:00100000:0.0:1787781813.766331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.766355:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962919168:0@lo:400: 00000100:00100000:0.0:1787781813.766388:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.766406:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787781813.766412:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962918784:0@lo:400: 00000100:00100000:0.0:1787781813.766434:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.766451:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962919296:0@lo:400: 00000100:00100000:0.0:1787781813.766470:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.766501:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918784 00000100:00100000:0.0:1787781813.766504:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918784 00000100:00100000:0.0:1787781813.766531:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919296 00000100:00100000:0.0:1787781813.766534:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919296 00000100:00100000:0.0:1787781813.766550:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781813.766556:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962918784:12345-0@lo:400: 00000100:00100000:0.0:1787781813.766593:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962918784:12345-0@lo:400: Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.766599:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781813.766632:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781813.766639:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962919296:12345-0@lo:400: 00000100:00100000:0.0:1787781813.766666:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962919296:12345-0@lo:400: Request processed in 28us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.766672:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787781813.766709:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cda940 x1874624962918784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781813.766722:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962918784:0@lo:400: 00010000:00080000:0.0:1787781813.766732:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cdb480 x1874624962919296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781813.766739:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962919296:0@lo:400: 00000100:00080000:1.0:1787781813.766837:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781813.766843:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781813.766854:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919168 00000100:00100000:1.0:1787781813.766857:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919168 00000100:00100000:1.0:1787781813.766892:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787781813.766899:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962919168:12345-0@lo:400: 00000100:00100000:1.0:1787781813.766948:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962919168:12345-0@lo:400: Request processed in 50us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781813.766954:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787781813.766971:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962918912:0@lo:400: 00000100:00100000:1.0:1787781813.766992:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781813.767009:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962919424:0@lo:400: 00000100:00100000:1.0:1787781813.767027:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787781813.767057:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cdad00 x1874624962918528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781813.767072:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962918528:0@lo:13: 00000100:00100000:1.0:1787781813.767082:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787781813.767087:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962919040:0@lo:400: 00000100:00100000:1.0:1787781813.767109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781813.767125:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962919552:0@lo:400: 00000100:00100000:1.0:1787781813.767144:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781813.767168:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918912 00000100:00100000:1.0:1787781813.767171:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918912 00000100:00100000:1.0:1787781813.767192:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781813.767197:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962918912:12345-0@lo:400: 00000100:00100000:1.0:1787781813.767228:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962918912:12345-0@lo:400: Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781813.767233:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781813.767248:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919424 00000100:00100000:1.0:1787781813.767251:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919424 00000100:00100000:1.0:1787781813.767270:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919040 00000100:00100000:1.0:1787781813.767273:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919040 00000100:00100000:1.0:1787781813.767284:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787781813.767289:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962919424:12345-0@lo:400: 00000100:00100000:1.0:1787781813.767316:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962919424:12345-0@lo:400: Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781813.767322:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787781813.767332:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787781813.767337:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962919040:12345-0@lo:400: 00000100:00100000:1.0:1787781813.767359:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962919040:12345-0@lo:400: Request processed in 22us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781813.767371:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787781813.767385:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781813.767408:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962919168:0@lo:400: 00010000:00080000:1.0:1787781813.767427:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cd8000 x1874624962919040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781813.767436:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962919040:0@lo:400: 00000100:00100000:1.0:1787781813.767445:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962918912:0@lo:400: 00010000:00080000:1.0:1787781813.767453:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cd92c0 x1874624962919424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781813.767460:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962919424:0@lo:400: 00000100:00100000:0.0:1787781813.770252:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781813.770426:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962918656 00000100:00100000:2.0:1787781813.770436:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962918656 00000100:00100000:2.0:1787781813.770502:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787781813.770512:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3659:x1874624962918656:12345-0@lo:400: 00000100:00100000:2.0:1787781813.770603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3659:x1874624962918656:12345-0@lo:400: Request processed in 93us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.770633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787781813.770675:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919552 00000100:00100000:2.0:1787781813.770679:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919552 00000100:00100000:2.0:1787781813.770720:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781813.770726:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962919552:12345-0@lo:400: 00000100:00100000:2.0:1787781813.770778:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962919552:12345-0@lo:400: Request processed in 52us (3632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.770800:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787781813.770825:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781813.770849:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962918656:0@lo:400: 00010000:00080000:2.0:1787781813.770884:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cd9a40 x1874624962919552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781813.770894:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787781813.770916:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962919552:0@lo:400: 00000100:00100000:0.0:1787781813.773463:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962919680:0@lo:13: 00000100:00100000:0.0:1787781813.773536:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.773647:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919680 00000100:00100000:2.0:1787781813.773655:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919680 00000100:00100000:2.0:1787781813.773698:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781813.773705:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962919680:12345-0@lo:13: 00002000:00000024:2.0:1787781813.773725:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781813.773853:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962919680:12345-0@lo:13: Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.773859:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787781813.773894:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41d46580 x1874624962919680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781813.773923:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962919680:0@lo:13: 00010000:00010000:3.0:1787781814.341842:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781815.366829:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781815.813918:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962919808:0@lo:41: 00000100:00100000:2.0:1787781815.813986:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781815.814098:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919808 00000100:00100000:0.0:1787781815.814106:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919808 00000100:00100000:0.0:1787781815.814159:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781815.814167:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962919808:12345-0@lo:41: 00000004:00000024:0.0:1787781815.814199:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787781815.814250:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962919808:12345-0@lo:41: Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781815.814257:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787781815.814356:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962919808:0@lo:41: 00010000:00010000:3.0:1787781816.389833:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781817.413750:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781817.861907:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962919936:0@lo:41: 00000100:00100000:1.0:1787781817.861973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781817.862043:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962919936 00000100:00100000:1.0:1787781817.862050:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962919936 00000100:00100000:1.0:1787781817.862091:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787781817.862099:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962919936:12345-0@lo:41: 00000004:00000024:1.0:1787781817.862128:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787781817.862175:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962919936:12345-0@lo:41: Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781817.862184:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787781817.862227:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962919936:0@lo:41: 00010000:00010000:3.0:1787781818.438247:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781818.886751:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962920064:0@lo:13: 00000100:00100000:0.0:1787781818.886821:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781818.886924:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920064 00000100:00100000:0.0:1787781818.886931:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920064 00000100:00100000:0.0:1787781818.886983:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781818.886993:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962920064:12345-0@lo:13: 00002000:00000024:0.0:1787781818.887020:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781818.887277:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962920320:0@lo:400: 00000100:00100000:1.0:1787781818.887319:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781818.887368:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962920832:0@lo:400: 00000100:00100000:1.0:1787781818.887397:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781818.887434:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787781818.887440:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962920192:0@lo:400: 00000100:00100000:1.0:1787781818.887467:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781818.887489:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962920704:0@lo:400: 00000100:00100000:1.0:1787781818.887511:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781818.887538:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920320 00000100:00100000:1.0:1787781818.887542:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920320 00000100:00100000:1.0:1787781818.887573:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920832 00000100:00100000:1.0:1787781818.887577:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920832 00000100:00100000:1.0:1787781818.887599:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781818.887633:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962920320:12345-0@lo:400: 00000100:00100000:1.0:1787781818.887685:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962920320:12345-0@lo:400: Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781818.887709:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781818.887726:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781818.887732:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962920832:12345-0@lo:400: 00000100:00100000:1.0:1787781818.887759:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962920832:12345-0@lo:400: Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781818.887765:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787781818.887802:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fe2d00 x1874624962920320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781818.887814:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962920320:0@lo:400: 00010000:00080000:1.0:1787781818.887825:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d506eda40 x1874624962920832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781818.887850:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962920832:0@lo:400: 00000100:00100000:0.0:1787781818.888089:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962920064:12345-0@lo:13: Request processed in 1096us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.888098:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787781818.888119:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781818.888124:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781818.888137:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962920448:0@lo:400: 00000100:00100000:0.0:1787781818.888162:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781818.888190:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962920960:0@lo:400: 00000100:00100000:0.0:1787781818.888212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781818.888241:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781818.888250:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962920576:0@lo:400: 00000100:00100000:0.0:1787781818.888271:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781818.888287:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962921088:0@lo:400: 00000100:00100000:0.0:1787781818.888308:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781818.888336:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921088 00000100:00100000:0.0:1787781818.888339:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921088 00000100:00100000:0.0:1787781818.888373:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781818.888380:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962921088:12345-0@lo:400: 00000100:00100000:0.0:1787781818.888547:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962921088:12345-0@lo:400: Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.888556:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787781818.888572:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781818.888584:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920960 00000100:00100000:0.0:1787781818.888588:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920960 00000100:00100000:0.0:1787781818.888630:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920576 00000100:00100000:0.0:1787781818.888634:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920576 00000100:00100000:0.0:1787781818.888647:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787781818.888653:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962920960:12345-0@lo:400: 00000100:00100000:0.0:1787781818.888686:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962920960:12345-0@lo:400: Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.888762:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787781818.888777:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787781818.888784:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962920576:12345-0@lo:400: 00000100:00100000:0.0:1787781818.888813:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962920576:12345-0@lo:400: Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.888818:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787781818.888833:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787781818.888863:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fe1e00 x1874624962920576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781818.888872:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962920576:0@lo:400: 00010000:00080000:0.0:1787781818.888894:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4c0e8b40 x1874624962921088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781818.888901:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962921088:0@lo:400: 00010000:00080000:0.0:1787781818.888909:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d506ef480 x1874624962920960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781818.888917:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962920960:0@lo:400: 00010000:00080000:0.0:1787781818.888951:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c41cdb840 x1874624962920064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781818.888965:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962920064:0@lo:13: 00000100:00100000:0.0:1787781818.889010:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920704 00000100:00100000:0.0:1787781818.889014:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920704 00000100:00100000:0.0:1787781818.889102:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920448 00000100:00100000:0.0:1787781818.889106:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920448 00000100:00100000:0.0:1787781818.889123:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781818.889130:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962920704:12345-0@lo:400: 00000100:00100000:0.0:1787781818.889172:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962920704:12345-0@lo:400: Request processed in 43us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.889178:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781818.889190:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781818.889195:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962920448:12345-0@lo:400: 00000100:00100000:0.0:1787781818.889225:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962920448:12345-0@lo:400: Request processed in 31us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.889241:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781818.889260:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962920192 00000100:00100000:0.0:1787781818.889264:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962920192 00000100:00100000:0.0:1787781818.889288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787781818.889295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962920192:12345-0@lo:400: 00000100:00100000:0.0:1787781818.889326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962920192:12345-0@lo:400: Request processed in 32us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781818.889331:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787781818.889370:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962920448:0@lo:400: 00000100:00100000:0.0:1787781818.889399:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962920192:0@lo:400: 00000100:00100000:0.0:1787781818.889409:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962920704:0@lo:400: 00000100:00100000:1.0:1787781818.895160:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962921216:0@lo:13: 00000100:00100000:1.0:1787781818.895231:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781818.898687:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921216 00000100:00100000:1.0:1787781818.898713:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921216 00000100:00100000:1.0:1787781818.898772:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787781818.898781:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962921216:12345-0@lo:13: 00002000:00000024:1.0:1787781818.898803:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781818.898894:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962921216:12345-0@lo:13: Request processed in 115us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781818.898901:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787781818.899072:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42690b40 x1874624962921216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781818.899095:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962921216:0@lo:13: 00010000:00010000:3.0:1787781819.462864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781820.490328:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781820.935104:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962921344:0@lo:41: 00000100:00100000:0.0:1787781820.935173:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781820.935305:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921344 00000100:00100000:2.0:1787781820.935313:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921344 00000100:00100000:2.0:1787781820.935361:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787781820.935370:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962921344:12345-0@lo:41: 00000004:00000024:2.0:1787781820.935404:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787781820.935465:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962921344:12345-0@lo:41: Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781820.935473:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781820.935517:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962921344:0@lo:41: 00010000:00010000:3.0:1787781821.511451:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787781821.982988:0:9522:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787781821.982992:0:9522:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787781821.982993:0:9522:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787781821.983138:0:9522:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993d7c44e000 00000020:01000004:2.0:1787781821.983152:0:9522:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787781821.983165:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787781821.983185:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff993c43063370) 00000020:00000080:2.0:1787781821.983201:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787781822.067143:0:9522:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787781822.067204:0:9522:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787781822.089465:0:9522:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787781822.089952:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787781822.089966:0:9522:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787781822.089978:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6d6745c150631ba 00000020:01000004:3.0:1787781822.089985:0:9522:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787781822.090006:0:9522:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787781822.090010:0:9522:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787781822.090023:0:9522:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787781822.090055:0:9522:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787781822.090060:0:9522:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787781822.108662:0:9522:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787781822.108700:0:9522:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.116@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787781822.108705:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787781822.108706:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781822.108708:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781822.108709:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781822.108710:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781822.108711:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781822.108712:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781822.108713:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781822.108714:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781822.108716:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781822.108717:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781822.108721:0:9522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787781822.108723:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781822.108796:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781822.108797:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781822.108798:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781822.108799:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781822.108800:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781822.108801:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781822.108802:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781822.108803:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781822.108804:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781822.108805:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781822.108832:0:9522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787781822.108847:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962921472:0@lo:253: 00000100:00100000:3.0:1787781822.108923:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.108969:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781822.109587:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921472 00000100:00100000:1.0:1787781822.109596:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921472 00000100:00100000:1.0:1787781822.109659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787781822.109670:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:9522:x1874624962921472:12345-0@lo:253: 20000000:01000000:1.0:1787781822.109703:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787781822.109707:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787781822.109713:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787781822.109716:0:6523:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787781822.112472:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781822.112852:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787781822.112884:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787781822.112902:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787781822.112915:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787781822.112927:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787781822.112938:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787781822.113041:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787781822.113058:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:3.0:1787781822.113059:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:3.0:1787781822.113070:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787781822.113075:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787781822.113084:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787781822.113088:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:3.0:1787781822.113096:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787781822.113102:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787781822.113111:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787781822.113122:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787781822.113180:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787781822.113188:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:3.0:1787781822.113190:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:3.0:1787781822.113200:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787781822.113205:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787781822.113216:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787781822.113220:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:3.0:1787781822.113230:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787781822.113234:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787781822.113243:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787781822.113270:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787781822.115021:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787781822.115047:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.116@tcp 20000000:01000000:3.0:1787781822.115050:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.116@tcp (null) (null) (null) 00000040:00080000:3.0:1787781822.115066:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787781822.115073:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787781822.115087:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787781822.115102:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.116@tcp (null) (null) 00000040:00080000:3.0:1787781822.115119:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787781822.115125:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787781822.115138:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787781822.115153:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787781822.115166:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787781822.115169:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787781822.115173:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787781822.115235:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787781822.115238:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781822.120484:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781822.120527:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781822.120546:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787781822.120851:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787781822.120886:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787781822.120901:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787781822.120912:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787781822.120914:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787781822.124066:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787781822.124194:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787781822.124222:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787781822.124236:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787781822.124246:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787781822.124248:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781822.124737:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781822.124759:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781822.124776:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787781822.124846:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787781822.124876:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787781822.124890:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787781822.124898:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787781822.124899:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787781822.125533:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787781822.125562:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787781822.125576:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787781822.125694:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787781822.125714:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787781822.125729:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787781822.125737:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787781822.125740:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781822.126224:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781822.126244:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781822.126257:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1787781822.126350:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1787781822.126367:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1787781822.126379:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1787781822.126394:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781822.126423:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126441:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126449:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630da expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126470:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063119 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126477:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063135 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126483:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506315f expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126490:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506317b expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126496:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126504:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126541:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126557:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 21 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.126571:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921600:0@lo:104: 00000100:00100000:2.0:1787781822.126655:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.126698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921600 00000100:00100000:0.0:1787781822.126705:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921600 00010000:00010000:2.0:1787781822.126708:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126716:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 21 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.126745:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787781822.126748:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921728:0@lo:104: 00000100:00100000:0.0:1787781822.126753:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962921600:12345-0@lo:104: 00010000:00010000:0.0:1787781822.126765:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.126770:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781822.126786:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126795:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 21 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.126802:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921856:0@lo:104: 00010000:00010000:0.0:1787781822.126806:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781822.126811:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962921600:12345-0@lo:104: Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.126819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787781822.126820:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.126833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921728 00010000:00010000:2.0:1787781822.126834:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.126835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921728 00010000:00010000:2.0:1787781822.126842:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 21 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.126845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921856 00000100:00100000:0.0:1787781822.126847:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921856 00000100:00100000:2.0:1787781822.126851:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921984:0@lo:104: 00000100:00100000:0.0:1787781822.126857:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781822.126876:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962921728:12345-0@lo:104: 00000100:00100000:2.0:1787781822.126883:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781822.126883:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126897:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.126905:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 21 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.126913:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922112:0@lo:104: 00010000:00010000:0.0:1787781822.126916:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781822.126921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962921728:12345-0@lo:104: Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.126926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787781822.126929:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.126936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962921984 00000100:00100000:0.0:1787781822.126939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962921984 00010000:00010000:2.0:1787781822.126943:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.126949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922112 00000100:00100000:0.0:1787781822.126951:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922112 00000100:00100000:0.0:1787781822.126959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787781822.126961:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 21 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.126964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962921856:12345-0@lo:104: 00000100:00100000:2.0:1787781822.126970:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922240:0@lo:104: 00010000:00010000:0.0:1787781822.126971:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.126992:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781822.126993:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787781822.126997:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962921856:12345-0@lo:104: Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.127002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787781822.127019:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.127027:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787781822.127028:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 21 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.127035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922240 00000100:00100000:2.0:1787781822.127036:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922368:0@lo:104: 00000100:00100000:0.0:1787781822.127037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922240 00000100:00100000:0.0:1787781822.127049:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781822.127054:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.127054:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962921984:12345-0@lo:104: 00010000:00010000:0.0:1787781822.127061:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.127063:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.127080:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921600:0@lo:104: 00010000:00010000:0.0:1787781822.127081:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787781822.127085:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962921984:12345-0@lo:104: Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.127088:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921728:0@lo:104: 00000100:00100000:2.0:1787781822.127094:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921856:0@lo:104: 00000100:00100000:0.0:1787781822.127096:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781822.127100:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962921984:0@lo:104: 00000100:00100000:0.0:1787781822.127106:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922368 00000100:00100000:0.0:1787781822.127108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922368 00000100:00100000:0.0:1787781822.127120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781822.127125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962922112:12345-0@lo:104: 00010000:00010000:0.0:1787781822.127132:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127172:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787781822.127177:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:6523:x1874624962922112:12345-0@lo:104: Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.127183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781822.127194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781822.127199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962922240:12345-0@lo:104: 00010000:00010000:0.0:1787781822.127206:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127228:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787781822.127233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6523:x1874624962922240:12345-0@lo:104: Request processed in 35us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.127238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781822.127265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781822.127271:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962922368:12345-0@lo:104: 00010000:00010000:0.0:1787781822.127277:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127299:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787781822.127309:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6523:x1874624962922368:12345-0@lo:104: Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.127315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787781822.127335:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787781822.127341:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127348:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039e00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127352:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127360:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127367:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127373:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127402:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127408:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127424:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43039e00/0xc6d6745c150631a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127443:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787781822.127446:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127461:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127464:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127481:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127486:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127491:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127504:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127509:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127514:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127520:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506317b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127528:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787781822.127531:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127537:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127540:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127556:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127562:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127568:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127579:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127584:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127597:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127603:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150f600/0xc6d6745c1506315f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127627:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787781822.127630:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127635:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150e000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127638:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127644:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127649:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127659:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127672:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127678:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127683:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127689:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150e000/0xc6d6745c15063135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506313c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.127697:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962922496:0@lo:103: 00010000:00010000:0.0:1787781822.127699:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787781822.127701:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127707:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150fe00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127709:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127715:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127721:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127726:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127738:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127744:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127755:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127761:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150fe00/0xc6d6745c15063119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063120 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127771:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781822.127774:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127779:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150ec00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127782:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127788:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127794:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127799:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.127811:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127817:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127821:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150ec00/0xc6d6745c150630da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127834:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781822.127843:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127848:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.127851:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127868:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.127874:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.127879:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787781822.127881:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781822.127902:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.127907:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962923008:0@lo:103: 00010000:00010000:0.0:1787781822.127908:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.127911:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.127917:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8a00/0xc6d6745c150630b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.127926:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781822.127930:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781822.127932:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781822.127934:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781822.127943:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962922624:0@lo:103: 00010000:00010000:3.0:1787781822.127948:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781822.127959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922496 00000100:00100000:3.0:1787781822.127963:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922496 00000100:00100000:0.0:1787781822.127965:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.127981:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962923136:0@lo:103: 00010000:00010000:3.0:1787781822.127982:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 22 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.127995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923008 00000100:00100000:3.0:1787781822.127997:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923008 00010000:00010000:3.0:1787781822.128006:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 23 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128010:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.128016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922624 00000100:00100000:3.0:1787781822.128019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922624 00010000:00010000:3.0:1787781822.128028:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 24 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128030:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962922752:0@lo:103: 00000100:00100000:3.0:1787781822.128038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923136 00000100:00100000:3.0:1787781822.128046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923136 00000100:00100000:0.0:1787781822.128049:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781822.128057:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 25 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128058:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962923264:0@lo:103: 00000100:00100000:3.0:1787781822.128068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922752 00000100:00100000:3.0:1787781822.128071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922752 00000100:00100000:0.0:1787781822.128074:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781822.128080:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 26 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128083:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781822.128088:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962922880:0@lo:103: 00000100:00100000:3.0:1787781822.128089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923264 00000100:00100000:3.0:1787781822.128091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923264 00010000:00010000:3.0:1787781822.128100:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 27 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128104:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.128110:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962922880 00000100:00100000:3.0:1787781822.128113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962922880 00010000:00010000:3.0:1787781822.128123:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 28 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781822.128127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787781822.128133:0:6516:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787781822.128134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+28:3657:x1874624962922496:12345-0@lo:103: 00000100:00100000:3.0:1787781822.128139:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787781822.128144:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128150:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 28 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128161:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 28 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128173:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480600/0xc6d6745c150631ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150631a5 expref: 28 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128184:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.128210:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+27:3657:x1874624962922496:12345-0@lo:103: Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781822.128229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781822.128234:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3657:x1874624962923008:12345-0@lo:103: 00010000:00010000:0.0:1787781822.128240:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128249:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 26 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128256:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 26 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128265:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.128285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3657:x1874624962923008:12345-0@lo:103: Request processed in 51us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781822.128302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787781822.128307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3658:x1874624962922624:12345-0@lo:103: 00010000:00010000:0.0:1787781822.128313:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128317:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 25 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128326:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 25 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128335:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43038400/0xc6d6745c15063182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506317b expref: 25 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128344:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.128364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962922624:12345-0@lo:103: Request processed in 58us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787781822.128380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787781822.128385:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3658:x1874624962923136:12345-0@lo:103: 00010000:00010000:0.0:1787781822.128391:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128399:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 23 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128407:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 23 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128415:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.128437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3658:x1874624962923136:12345-0@lo:103: Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128442:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787781822.128488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781822.128494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3659:x1874624962922752:12345-0@lo:103: 00010000:00010000:0.0:1787781822.128501:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128505:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 22 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128514:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 22 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128523:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506315f expref: 22 pid: 6525 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128531:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.128561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3659:x1874624962922752:12345-0@lo:103: Request processed in 69us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128567:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781822.128578:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781822.128583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3659:x1874624962923264:12345-0@lo:103: 00010000:00010000:0.0:1787781822.128590:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.128599:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 20 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128624:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 20 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.128634:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781822.128654:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962922752:0@lo:103: 00000100:00100000:0.0:1787781822.128981:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3659:x1874624962923264:12345-0@lo:103: Request processed in 397us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.128988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781822.129001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781822.129069:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624962922880:12345-0@lo:103: 00010000:00010000:0.0:1787781822.129078:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.129082:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 19 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129091:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 19 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129102:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43038000/0xc6d6745c1506313c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063135 expref: 19 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129113:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129121:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129135:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129150:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129156:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129162:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129166:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41480200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781822.129170:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129177:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129185:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.129194:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.129216:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3659:x1874624962922880:12345-0@lo:103: Request processed in 210us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.129222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781822.129255:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962923008:0@lo:103: 00000100:00100000:0.0:1787781822.129263:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962922496:0@lo:103: 00000100:00100000:0.0:1787781822.129286:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962922624:0@lo:103: 00000100:00100000:0.0:1787781822.129294:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962923136:0@lo:103: 00000100:00100000:0.0:1787781822.129322:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962922880:0@lo:103: 00000100:00100000:0.0:1787781822.129329:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962923264:0@lo:103: 00010000:00010000:2.0:1787781822.133205:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e600/0xc6d6745c15063120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063119 expref: 17 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.133227:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922112:0@lo:104: 00010000:00010000:2.0:1787781822.133242:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039800/0xc6d6745c150630e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150630da expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.133250:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922240:0@lo:104: 00010000:00010000:2.0:1787781822.133275:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150fa00/0xc6d6745c150630b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150630b0 expref: 15 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.133285:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1874624962922368:0@lo:104: 00010000:00010000:2.0:1787781822.133330:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.133341:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.133348:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.133355:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480200/0xc6d6745c150631c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787781822.133371:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787781822.135663:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:9522:x1874624962921472:12345-0@lo:253: Request processed in 25928us (26672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.135679:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787781822.135983:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962921472:0@lo:253: 10000000:01000000:3.0:1787781822.136003:0:9522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787781822.136009:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787781822.136010:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781822.136012:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781822.136013:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787781822.136014:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781822.136015:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781822.136017:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781822.136018:0:9522:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787781822.136020:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781822.136021:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787781822.136043:0:9522:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993d7c44e000 from lustre-OST0001 10000000:01000000:3.0:1787781822.136070:0:9522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787781822.136083:0:9522:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787781822.136098:0:9522:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993d588099b8 local copy 10000000:01000000:3.0:1787781822.136102:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787781822.136145:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.136159:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.136173:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.136196:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923392:0@lo:101: 00000100:00100000:3.0:1787781822.136245:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.136281:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923392 00000100:00100000:3.0:1787781822.136283:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.136287:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923392 00000100:00100000:0.0:1787781822.136331:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787781822.136340:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:9522:x1874624962923392:12345-0@lo:101: 00010000:00010000:0.0:1787781822.136351:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781822.136365:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9400/0xc6d6745c150631cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150631c8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.136387:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9400/0xc6d6745c150631cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150631c8 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.136397:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9400/0xc6d6745c150631cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631c8 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.136406:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9400, rc 0) 00000100:00100000:0.0:1787781822.136462:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923392:12345-0@lo:101: Request processed in 123us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.136468:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787781822.137289:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923392:0@lo:101: 00010000:00010000:3.0:1787781822.137309:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.137322:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.137445:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923520:0@lo:501: 00000100:00100000:3.0:1787781822.137479:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.137516:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.137518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923520 00000100:00100000:2.0:1787781822.137523:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923520 00000100:00100000:2.0:1787781822.137562:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787781822.137570:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923520:12345-0@lo:501: 00000100:00100000:2.0:1787781822.137711:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923520:12345-0@lo:501: Request processed in 142us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781822.137719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787781822.138566:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923520:0@lo:501: 10000000:01000000:3.0:1787781822.138591:0:9522:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787781822.138653:0:9522:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787781822.138661:0:9522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.138688:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.138695:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.138773:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787781822.138803:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d7c44e000 10000000:01000000:2.0:1787781822.138813:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787781822.138819:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787781822.138822:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781822.138826:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787781822.138828:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787781822.138856:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.138873:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.138883:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.138900:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923648:0@lo:101: 00000100:00100000:2.0:1787781822.138945:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781822.138974:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3000 going to sleep for 11 seconds 00010000:00010000:0.0:1787781822.139020:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781822.139028:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139036:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781822.139040:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139059:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781822.139066:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781822.139071:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781822.139090:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139096:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781822.139128:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139136:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c150631c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6d6745c150631cf expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139148:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781822.139150:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781822.139151:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781822.139247:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781822.139260:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962923776:0@lo:103: 00000100:00100000:2.0:1787781822.139290:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.139353:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923776 00000100:00100000:0.0:1787781822.139359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923776 00000100:00100000:0.0:1787781822.139420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781822.139430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3659:x1874624962923776:12345-0@lo:103: 00010000:00010000:0.0:1787781822.139442:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781822.139456:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9400/0xc6d6745c150631cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c150631c8 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.139470:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781822.139512:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:3659:x1874624962923776:12345-0@lo:103: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.139520:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781822.139549:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962923776:0@lo:103: 00000100:00100000:3.0:1787781822.139637:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923648 00000100:00100000:3.0:1787781822.139642:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923648 00000100:00100000:3.0:1787781822.139670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787781822.139677:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+14:9522:x1874624962923648:12345-0@lo:101: 00010000:00010000:3.0:1787781822.139689:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781822.139701:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150631d6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.139718:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.139745:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.139752:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167200, rc 0) 00000100:00100000:3.0:1787781822.139798:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923648:12345-0@lo:101: Request processed in 122us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.139804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787781822.139820:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923648:0@lo:101: 00010000:00010000:2.0:1787781822.139831:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.139839:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781822.139920:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923904:0@lo:501: 00000100:00100000:2.0:1787781822.139947:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781822.139983:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.140028:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962923904 00000100:00100000:0.0:1787781822.140033:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962923904 00000100:00100000:0.0:1787781822.140060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787781822.140067:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923904:12345-0@lo:501: 00000100:00100000:0.0:1787781822.140171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962923904:12345-0@lo:501: Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.140179:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787781822.140342:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962923904:0@lo:501: 00000100:00100000:1.0:1787781822.140380:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924032:0@lo:503: 00000100:00100000:1.0:1787781822.140431:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.140453:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781822.140562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924032 00000100:00100000:3.0:1787781822.140569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924032 00000100:00100000:3.0:1787781822.140601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787781822.140624:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924032:12345-0@lo:503: 00000100:00100000:2.0:1787781822.140744:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924032:12345-0@lo:503: Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.140751:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787781822.140774:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924032:0@lo:503: 00000040:00080000:1.0:1787781822.141083:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787781822.141238:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924160:0@lo:502: 00000100:00100000:1.0:1787781822.141289:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.141320:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.141322:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924160 00000100:00100000:2.0:1787781822.141327:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924160 00000100:00100000:2.0:1787781822.141362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787781822.141368:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924160:12345-0@lo:502: 00000100:00100000:2.0:1787781822.141465:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924160:12345-0@lo:502: Request processed in 96us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.141472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787781822.141558:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924160:0@lo:502: 00000040:00080000:2.0:1787781822.141810:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787781822.141836:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787781822.141851:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787781822.141879:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787781822.141893:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787781822.141905:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787781822.141924:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924288:0@lo:502: 00000100:00100000:2.0:1787781822.141957:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781822.141988:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.142032:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924288 00000100:00100000:0.0:1787781822.142037:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924288 00000100:00100000:0.0:1787781822.142070:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787781822.142077:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924288:12345-0@lo:502: 00000100:00100000:0.0:1787781822.142160:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924288:12345-0@lo:502: Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.142166:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787781822.142543:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924288:0@lo:502: 00000040:00080000:1.0:1787781822.142602:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787781822.142638:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1787781822.146666:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787781822.146678:0:9534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787781822.146684:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781822.146687:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787781822.146693:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781822.146710:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff993d67c40000) 00000020:00000080:1.0:1787781822.146736:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787781822.146741:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787781822.146837:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7c44e000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787781822.146845:0:9534:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787781822.146851:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6d6745c150631eb 00010000:00010000:0.0:1787781822.159264:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787781822.168002:0:9534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787781822.171244:0:9534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787781822.171672:0:9534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787781822.178192:0:9534:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787781822.178368:0:9534:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787781822.184945:0:9534:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787781822.187078:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787781822.187091:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781822.187098:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781822.187100:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787781822.187104:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781822.187108:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781822.187114:0:9534:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787781822.187118:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787781822.187120:0:9534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787781822.187143:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781822.187146:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781822.187148:0:9534:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787781822.187152:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787781822.193154:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787781822.193201:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787781822.193226:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.193239:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781822.193247:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7c44e000 from 1 10000000:01000000:3.0:1787781822.193250:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781822.193289:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.193298:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.193310:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.193330:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924416:0@lo:101: 00000100:00100000:3.0:1787781822.193392:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.193441:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.193506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924416 00000100:00100000:0.0:1787781822.193514:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924416 00000100:00100000:0.0:1787781822.193570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787781822.193578:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:9522:x1874624962924416:12345-0@lo:101: 00010000:00010000:0.0:1787781822.193592:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781822.193626:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150631f2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.193648:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.193658:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.193666:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9400, rc 0) 00000100:00100000:0.0:1787781822.193702:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924416:12345-0@lo:101: Request processed in 125us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.193709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787781822.193909:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924416:0@lo:101: 00010000:00010000:3.0:1787781822.193922:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.193931:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.194022:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924544:0@lo:501: 00000100:00100000:3.0:1787781822.194048:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.194075:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.194129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924544 00000100:00100000:2.0:1787781822.194135:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924544 00000100:00100000:2.0:1787781822.194169:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781822.194176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924544:12345-0@lo:501: 00000100:00100000:2.0:1787781822.194273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924544:12345-0@lo:501: Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.194280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787781822.194388:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924544:0@lo:501: 00000100:00100000:3.0:1787781822.194412:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924672:0@lo:503: 00000100:00100000:3.0:1787781822.194448:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.194475:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.194552:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924672 00000100:00100000:2.0:1787781822.194556:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924672 00000100:00100000:2.0:1787781822.194590:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787781822.194595:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924672:12345-0@lo:503: 00000100:00100000:3.0:1787781822.197927:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924672:12345-0@lo:503: Request processed in 3323us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.197942:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787781822.198142:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924672:0@lo:503: 00000040:00080000:0.0:1787781822.198537:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787781822.198640:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924800:0@lo:502: 00000100:00100000:0.0:1787781822.198698:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.198736:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.198795:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924800 00000100:00100000:2.0:1787781822.198801:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924800 00000100:00100000:3.0:1787781822.198897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787781822.198906:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924800:12345-0@lo:502: 00000100:00100000:3.0:1787781822.198999:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924800:12345-0@lo:502: Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.199005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787781822.199537:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924800:0@lo:502: 00000040:00080000:1.0:1787781822.199785:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787781822.199821:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787781822.199848:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924928:0@lo:502: 00000100:00100000:1.0:1787781822.199899:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.199931:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781822.200102:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962924928 00000100:00100000:3.0:1787781822.200108:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962924928 00000100:00100000:3.0:1787781822.200148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781822.200156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924928:12345-0@lo:502: 00000100:00100000:3.0:1787781822.202567:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962924928:12345-0@lo:502: Request processed in 2403us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.202582:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787781822.204981:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962924928:0@lo:502: 00000040:00080000:3.0:1787781822.206941:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787781822.206964:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787781822.208035:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781822.208046:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781822.208048:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787781822.208055:0:9538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d7c44e000 00000020:00000080:0.0:1787781822.208058:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787781822.208069:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781822.208071:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781822.208073:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787781822.208075:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787781822.212465:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787781822.212531:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781822.212550:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.212563:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781822.212624:0:9522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787781822.212626:0:9522:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d7c44e000 10000000:01000000:3.0:1787781822.212629:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d7c44e000 10000000:01000000:3.0:1787781822.212633:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787781822.212638:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d7c44e000 from 1 10000000:01000000:3.0:1787781822.212640:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781822.212673:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.212682:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.212698:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.212717:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925056:0@lo:101: 00000100:00100000:3.0:1787781822.212775:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.212811:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042780 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.213113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925056 00000100:00100000:0.0:1787781822.213119:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925056 00000100:00100000:0.0:1787781822.213163:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787781822.213177:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9522:x1874624962925056:12345-0@lo:101: 00010000:00010000:0.0:1787781822.213189:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781822.213201:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063200 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.213222:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063200 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.213233:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063200 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781822.213241:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8a00, rc 0) 00000100:00100000:0.0:1787781822.213275:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925056:12345-0@lo:101: Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.213281:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787781822.213704:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925056:0@lo:101: 00010000:00010000:3.0:1787781822.213718:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.213727:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.213818:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925184:0@lo:501: 00000100:00100000:3.0:1787781822.213846:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.213889:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042780 going to sleep for 11 seconds 00000100:00100000:0.0:1787781822.213940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925184 00000100:00100000:0.0:1787781822.213944:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925184 00000100:00100000:0.0:1787781822.213967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787781822.213973:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925184:12345-0@lo:501: 00000100:00100000:0.0:1787781822.214092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925184:12345-0@lo:501: Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.214098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787781822.214255:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925184:0@lo:501: 00000100:00100000:1.0:1787781822.214284:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925312:0@lo:503: 00000100:00100000:1.0:1787781822.214326:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.214350:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781822.214574:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925312 00000100:00100000:3.0:1787781822.214579:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925312 00000100:00100000:3.0:1787781822.214634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787781822.214641:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925312:12345-0@lo:503: 00000100:00100000:3.0:1787781822.214732:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925312:12345-0@lo:503: Request processed in 91us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.214739:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787781822.214829:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925312:0@lo:503: 00000040:00080000:2.0:1787781822.215133:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787781822.215210:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925440:0@lo:502: 00000100:00100000:2.0:1787781822.215249:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781822.215284:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787781822.215426:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925440 00000100:00100000:3.0:1787781822.215431:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925440 00000100:00100000:3.0:1787781822.215454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781822.215461:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925440:12345-0@lo:502: 00000100:00100000:3.0:1787781822.215551:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925440:12345-0@lo:502: Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.215558:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787781822.216183:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925440:0@lo:502: 00000040:00080000:2.0:1787781822.216396:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787781822.216503:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787781822.216520:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787781822.216535:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787781822.216549:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787781822.216561:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787781822.216573:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787781822.216585:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787781822.216597:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787781822.217454:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787781822.217507:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787781822.217523:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787781822.217537:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787781822.217549:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787781822.217562:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787781822.217576:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787781822.217590:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787781822.217601:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787781822.217635:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787781822.217651:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787781822.217676:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787781822.217691:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787781822.217703:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787781822.217716:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787781822.217728:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787781822.217742:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787781822.217769:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787781822.217785:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787781822.217799:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787781822.217812:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787781822.217825:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787781822.217838:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787781822.217852:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787781822.217878:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787781822.217894:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787781822.217909:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787781822.217922:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787781822.217935:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787781822.217947:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787781822.217960:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787781822.217972:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787781822.217983:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787781822.218005:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787781822.218098:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787781822.218115:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787781822.218128:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787781822.218173:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925568:0@lo:502: 00000100:00100000:2.0:1787781822.218250:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781822.218298:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787781822.218650:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925568 00000100:00100000:3.0:1787781822.218657:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925568 00000100:00100000:3.0:1787781822.218709:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787781822.218718:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925568:12345-0@lo:502: 00000100:00100000:3.0:1787781822.218831:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962925568:12345-0@lo:502: Request processed in 114us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.218839:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787781822.224730:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962925568:0@lo:502: 00000040:00080000:2.0:1787781822.224842:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787781822.224881:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787781822.225503:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787781822.225517:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff993c43064d28) 00000020:00000080:2.0:1787781822.225541:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787781822.225677:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7c44e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787781822.225681:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7c44e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787781822.225684:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7c44e000 3 00010000:00080000:2.0:1787781822.225711:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c4346c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787781822.228891:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787781822.229171:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787781822.229219:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787781822.229231:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6d6745c15063215 00000100:00080000:3.0:1787781822.229242:0:9539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781822.229248:0:9539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787781822.229284:0:9539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c42690000 x1874624962925696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787781822.229345:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624962925696:0@lo:38: 00000100:00100000:1.0:1787781822.229416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787781822.232625:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787781822.234688:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962926208:0@lo:400: 00000100:00100000:1.0:1787781822.234771:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.234811:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962926720:0@lo:400: 00000100:00100000:1.0:1787781822.234837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.234857:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787781822.234876:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962926080:0@lo:400: 00000100:00100000:1.0:1787781822.234898:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.234929:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962926592:0@lo:400: 00000100:00100000:1.0:1787781822.234947:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.234978:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925696 00000100:00100000:1.0:1787781822.234985:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925696 00000100:00100000:1.0:1787781822.235129:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926080 00000100:00100000:1.0:1787781822.235132:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926080 00000100:00100000:1.0:1787781822.235158:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781822.235165:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962926080:12345-0@lo:400: 00000100:00100000:1.0:1787781822.235219:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962926080:12345-0@lo:400: Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.235225:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781822.235239:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781822.235243:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624962925696:12345-0@lo:38: 00010000:00080000:1.0:1787781822.235262:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1787781822.235291:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6d6745c1506321c 00000004:00100000:1.0:1787781822.235305:0:6533:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787781822.235330:0:6533:0:(import.c:65:import_set_state_nolock()) ffff993c431b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781822.235358:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874624962925696:12345-0@lo:38: Request processed in 114us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.235364:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781822.235383:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926208 00000100:00100000:1.0:1787781822.235386:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926208 00000100:00100000:1.0:1787781822.235406:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787781822.235517:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c426903c0 x1874624962926080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781822.235531:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962926080:0@lo:400: 00000100:00100000:1.0:1787781822.235792:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962926208:12345-0@lo:400: 00000100:00100000:0.0:1787781822.235947:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962925824:0@lo:400: 00000100:00100000:0.0:1787781822.235977:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.235997:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962926336:0@lo:400: 00000100:00100000:0.0:1787781822.236025:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.236038:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781822.236043:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962925952:0@lo:400: 00000100:00100000:0.0:1787781822.236071:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.236087:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962926464:0@lo:400: 00000100:00100000:0.0:1787781822.236102:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.236126:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925952 00000100:00100000:0.0:1787781822.236129:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925952 00000100:00100000:0.0:1787781822.236149:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781822.236155:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962925952:12345-0@lo:400: 00000100:00100000:0.0:1787781822.236185:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962925952:12345-0@lo:400: Request processed in 30us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781822.236191:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781822.236212:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962925952:0@lo:400: 00000100:00100000:1.0:1787781822.236320:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962926208:12345-0@lo:400: Request processed in 532us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236326:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787781822.236351:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926720 00000100:00100000:1.0:1787781822.236354:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926720 00000100:00100000:1.0:1787781822.236386:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926592 00000100:00100000:1.0:1787781822.236388:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926592 00000100:00100000:1.0:1787781822.236406:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781822.236421:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962926720:12345-0@lo:400: 00000100:00100000:1.0:1787781822.236449:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962926720:12345-0@lo:400: Request processed in 28us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236455:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781822.236464:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781822.236480:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962926592:12345-0@lo:400: 00000100:00100000:1.0:1787781822.236506:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962926592:12345-0@lo:400: Request processed in 27us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236511:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781822.236528:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962925824 00000100:00100000:1.0:1787781822.236531:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962925824 00000100:00100000:1.0:1787781822.236545:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926336 00000100:00100000:1.0:1787781822.236548:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926336 00000100:00100000:1.0:1787781822.236559:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926464 00000100:00100000:1.0:1787781822.236561:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926464 00000100:00100000:1.0:1787781822.236575:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787781822.236581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962925824:12345-0@lo:400: 00000100:00100000:1.0:1787781822.236638:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962925824:12345-0@lo:400: Request processed in 58us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236644:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787781822.236655:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781822.236660:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962926336:12345-0@lo:400: 00000100:00100000:1.0:1787781822.236685:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962926336:12345-0@lo:400: Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236697:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781822.236709:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781822.236715:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962926464:12345-0@lo:400: 00000100:00100000:1.0:1787781822.236742:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962926464:12345-0@lo:400: Request processed in 28us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.236748:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787781822.236792:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42692940 x1874624962926464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781822.236802:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962926464:0@lo:400: 00010000:00080000:1.0:1787781822.236812:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42692580 x1874624962925824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781822.236819:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962925824:0@lo:400: 00010000:00080000:1.0:1787781822.236826:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c426921c0 x1874624962926336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781822.236833:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962926336:0@lo:400: 00010000:00080000:1.0:1787781822.236856:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42690000 x1874624962925696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781822.236873:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781822.236880:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787781822.236886:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787781822.236890:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787781822.236893:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787781822.236899:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624962925696:0@lo:38: 00000100:00080000:0.0:1787781822.237307:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781822.237312:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781822.237314:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1787781822.238202:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787781822.238216:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff993c43060000) 00000020:00000080:2.0:1787781822.238238:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1787781822.238309:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d7c44e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787781822.238313:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7c44e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787781822.238315:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7c44e000 3 00010000:00080000:2.0:1787781822.238358:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c4346c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.116@tcp at head 00000100:00100000:0.0:1787781822.239226:0:9541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9541:1874624962926848:0@lo:901: 00000100:00100000:0.0:1787781822.239289:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781822.239322:0:9541:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781822.241355:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926848 00000100:00100000:1.0:1787781822.241367:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926848 00000100:00100000:3.0:1787781822.241427:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962926208:0@lo:400: 00010000:00080000:3.0:1787781822.241450:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42691680 x1874624962926720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781822.241462:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962926720:0@lo:400: 00000100:00080000:0.0:1787781822.241490:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787781822.241499:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c42691e00 x1874624962926592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781822.241510:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962926592:0@lo:400: 00000100:00100000:1.0:1787781822.241561:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781822.241571:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9541:x1874624962926848:12345-0@lo:901: 00000100:00100000:1.0:1787781822.241711:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9541:x1874624962926848:12345-0@lo:901: Request processed in 141us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.241718:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787781822.242870:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1787781822.243040:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787781822.243079:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787781822.243087:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc6d6745c1506322a 00000100:00080000:2.0:1787781822.243095:0:9539:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781822.243101:0:9539:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff993c4346c000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787781822.243135:0:9539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a7840 x1874624962926976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781822.243153:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787781822.244718:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624962926976:0@lo:38: 00000100:00100000:1.0:1787781822.244788:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.244831:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962926976 00000100:00100000:1.0:1787781822.244838:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962926976 00000100:00100000:1.0:1787781822.244883:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781822.244890:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624962926976:12345-0@lo:38: 00010000:00080000:1.0:1787781822.244917:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1787781822.244966:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc6d6745c15063231 00000004:00100000:1.0:1787781822.244982:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787781822.245026:0:6531:0:(import.c:65:import_set_state_nolock()) ffff993c431b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781822.245079:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874624962926976:12345-0@lo:38: Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.245087:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787781822.245136:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c431a7840 x1874624962926976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781822.245147:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781822.245154:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787781822.245160:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787781822.245164:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787781822.245172:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787781822.245179:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624962926976:0@lo:38: 00000040:00080000:2.0:1787781822.246873:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1787781822.247048:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787781822.247083:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787781822.247106:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.247118:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787781822.247167:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787781822.247169:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787781822.247172:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787781822.247173:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787781822.247175:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787781822.247177:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787781822.247178:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787781822.247180:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787781822.247182:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787781822.247184:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787781822.247185:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787781822.247189:0:9522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787781822.247192:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787781822.247194:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787781822.247195:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787781822.247197:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787781822.247199:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787781822.247200:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787781822.247202:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787781822.247203:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787781822.247204:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787781822.247205:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787781822.247206:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787781822.247227:0:9522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787781822.247241:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962927104:0@lo:253: 00000100:00100000:1.0:1787781822.247297:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781822.247327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927104 00000100:00100000:1.0:1787781822.247332:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927104 00000100:00100000:1.0:1787781822.247363:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781822.247370:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962927104:12345-0@lo:253: 20000000:01000000:1.0:1787781822.247390:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787781822.247402:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787781822.247786:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc480 going to sleep for 11 seconds 00010000:00080000:0.0:1787781822.247931:0:9541:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d4bea8000 x1874624962926848/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787781838 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781822.247944:0:9541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9541:1874624962926848:0@lo:901: 20000000:01000000:1.0:1787781822.262122:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787781822.262140:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787781822.262720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9522:x1874624962927104:12345-0@lo:253: Request processed in 15346us (15418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781822.262733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787781822.262880:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9522:1874624962927104:0@lo:253: 10000000:01000000:0.0:1787781822.262893:0:9522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787781822.262896:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787781822.262898:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787781822.262899:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781822.262901:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781822.262915:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781822.262917:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781822.262918:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787781822.262919:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781822.262921:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781822.262922:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781822.262924:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787781822.262939:0:9522:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787781822.263418:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787781822.263424:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787781822.263444:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263459:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263479:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506316d expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263486:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263520:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263537:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 16 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.263550:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962927232:0@lo:104: 00000100:00100000:3.0:1787781822.263594:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781822.263727:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.263736:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.263745:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962927360:0@lo:104: 00000100:00100000:3.0:1787781822.263766:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.264051:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027300 going to sleep for 11 seconds 00000100:00100000:2.0:1787781822.264085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927232 00000100:00100000:2.0:1787781822.264092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927232 00000100:00100000:1.0:1787781822.264111:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927360 00000100:00100000:1.0:1787781822.264117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927360 00000100:00100000:2.0:1787781822.264138:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781822.264148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962927232:12345-0@lo:104: 00010000:00010000:2.0:1787781822.264170:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781822.264305:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781822.264311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:6547:x1874624962927232:12345-0@lo:104: Request processed in 165us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.264418:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962927232:0@lo:104: 00010000:00010000:3.0:1787781822.264432:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781822.264438:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264456:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781822.264460:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264469:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781822.264477:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781822.264482:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781822.264511:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264517:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781822.264535:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264542:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038600/0xc6d6745c1506316d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264555:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781822.264557:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781822.264559:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781822.264574:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962927488:0@lo:103: 00000100:00100000:3.0:1787781822.264603:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.264661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927488 00000100:00100000:3.0:1787781822.264665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927488 00010000:00010000:3.0:1787781822.264805:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 17 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.264846:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787781822.264855:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:3657:x1874624962927488:12345-0@lo:103: 00010000:00010000:3.0:1787781822.264878:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781822.264884:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 17 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264895:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 17 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264910:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166200/0xc6d6745c15063174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506316d expref: 17 pid: 6523 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.264922:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781822.264958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3657:x1874624962927488:12345-0@lo:103: Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.264965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781822.265065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781822.265085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781822.265095:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962927360:12345-0@lo:104: 00010000:00010000:2.0:1787781822.265104:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781822.265111:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962927488:0@lo:103: 00010000:00010000:2.0:1787781822.265190:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781822.265196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:6547:x1874624962927360:12345-0@lo:104: Request processed in 104us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781822.265211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787781822.265330:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874624962927360:0@lo:104: 00010000:00010000:3.0:1787781822.265417:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.265581:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781822.265588:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.265596:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f800 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781822.265601:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.265663:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781822.265670:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781822.265689:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781822.265715:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.265721:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787781822.265769:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962927616:0@lo:103: 00000100:00100000:2.0:1787781822.265802:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781822.266849:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.266870:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150f800/0xc6d6745c15063127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506312e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.266877:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927616 00000100:00100000:3.0:1787781822.266886:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927616 00010000:00010000:1.0:1787781822.266891:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781822.266894:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781822.266896:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781822.266919:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781822.266955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787781822.266963:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3658:x1874624962927616:12345-0@lo:103: 00010000:00010000:3.0:1787781822.266976:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781822.266991:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267003:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267018:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9000/0xc6d6745c1506312e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063127 expref: 16 pid: 6526 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267031:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267039:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787781822.267055:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010730873s 00010000:00010000:3.0:1787781822.267059:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267066:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267074:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267079:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267085:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781822.267089:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267096:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267125:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781822.267135:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781822.267200:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.267258:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781822.267265:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166a00/0xc6d6745c15063238 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787781822.268808:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787781822.269202:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787781822.269738:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787781822.269916:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787781822.270227:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787781822.270403:0:9522:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1787781822.270696:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3658:x1874624962927616:12345-0@lo:103: Request processed in 3727us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.270710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781822.271190:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962927616:0@lo:103: 00000001:00000004:0.0:1787781822.271702:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787781822.283659:0:9522:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787781822.283669:0:9522:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787781822.283701:0:9522:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787781822.283735:0:9522:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787781822.283753:0:9522:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787781822.283774:0:9522:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787781822.284651:0:9522:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781822.284850:0:9522:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787781822.536771:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781822.982436:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781822.982458:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962927744:0@lo:41: 00000100:00100000:3.0:1787781822.982518:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781822.982570:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927744 00000100:00100000:3.0:1787781822.982577:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927744 00000100:00100000:3.0:1787781822.982641:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781822.982649:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962927744:12345-0@lo:41: 00000004:00000024:3.0:1787781822.982679:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787781822.982718:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962927744:12345-0@lo:41: Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781822.982724:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781822.982775:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962927744:0@lo:41: 00000020:00000004:2.0:1787781823.436793:0:9594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787781823.437038:0:9594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787781823.557832:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781824.009469:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781824.009491:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962927872:0@lo:13: 00000100:00100000:0.0:1787781824.009556:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781824.009658:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962927872 00000100:00100000:0.0:1787781824.009664:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962927872 00000100:00100000:0.0:1787781824.009717:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781824.009726:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962927872:12345-0@lo:13: 00002000:00000024:0.0:1787781824.009751:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781824.009795:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962927872:12345-0@lo:13: Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781824.009802:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787781824.009860:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781824.009875:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962928000:0@lo:13: 00000100:00100000:0.0:1787781824.009901:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787781824.009950:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bea8000 x1874624962927872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781824.009967:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962927872:0@lo:13: 00000100:00100000:0.0:1787781824.009990:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928000 00000100:00100000:0.0:1787781824.009994:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928000 00000100:00100000:0.0:1787781824.010019:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781824.010025:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962928000:12345-0@lo:13: 00002000:00000024:0.0:1787781824.010050:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781824.010080:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962928000:12345-0@lo:13: Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781824.010086:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787781824.010101:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787781824.010116:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0eb840 x1874624962928000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781824.010128:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962928000:0@lo:13: 00010000:00010000:3.0:1787781824.594353:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781825.605970:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781826.058648:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962928128:0@lo:41: 00000100:00100000:3.0:1787781826.058724:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781826.058795:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928128 00000100:00100000:3.0:1787781826.058802:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928128 00000100:00100000:3.0:1787781826.058855:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787781826.058864:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962928128:12345-0@lo:41: 00000004:00000024:3.0:1787781826.058914:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787781826.058962:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962928128:12345-0@lo:41: Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781826.058970:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787781826.059036:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962928128:0@lo:41: 00010000:00010000:3.0:1787781826.631481:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781827.589922:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962928256:0@lo:400: 00000100:00100000:1.0:1787781827.590004:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590055:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962928768:0@lo:400: 00000100:00100000:1.0:1787781827.590081:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590101:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962929280:0@lo:400: 00000100:00100000:1.0:1787781827.590123:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590148:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787781827.590154:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962928384:0@lo:400: 00000100:00100000:1.0:1787781827.590176:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590193:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962928896:0@lo:400: 00000100:00100000:1.0:1787781827.590213:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590229:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962929408:0@lo:400: 00000100:00100000:1.0:1787781827.590247:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590274:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962928512:0@lo:400: 00000100:00100000:1.0:1787781827.590296:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590314:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962929024:0@lo:400: 00000100:00100000:1.0:1787781827.590333:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590343:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962929536:0@lo:400: 00000100:00100000:1.0:1787781827.590376:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590401:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787781827.590407:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962928640:0@lo:400: 00000100:00100000:1.0:1787781827.590426:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590435:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962929152:0@lo:400: 00000100:00100000:1.0:1787781827.590452:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.590484:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928256 00000100:00100000:1.0:1787781827.590491:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928256 00000100:00100000:1.0:1787781827.590533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787781827.590541:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3659:x1874624962928256:12345-0@lo:400: 00000100:00100000:1.0:1787781827.590588:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3659:x1874624962928256:12345-0@lo:400: Request processed in 48us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.590596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787781827.590652:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928768 00000100:00100000:1.0:1787781827.590656:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928768 00000100:00100000:1.0:1787781827.590679:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928512 00000100:00100000:1.0:1787781827.590682:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928512 00000100:00100000:1.0:1787781827.590696:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781827.590701:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962928768:12345-0@lo:400: 00000100:00100000:1.0:1787781827.590735:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962928768:12345-0@lo:400: Request processed in 33us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.590741:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781827.590753:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787781827.590758:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962928512:12345-0@lo:400: 00000100:00100000:1.0:1787781827.590790:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962928512:12345-0@lo:400: Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.590796:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787781827.590823:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929280 00000100:00100000:1.0:1787781827.590827:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929280 00000100:00100000:1.0:1787781827.590871:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929152 00000100:00100000:1.0:1787781827.590879:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929152 00000100:00100000:1.0:1787781827.590900:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781827.590906:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962929280:12345-0@lo:400: 00000100:00100000:1.0:1787781827.590938:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962929280:12345-0@lo:400: Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.590944:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781827.590954:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781827.590960:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962929152:12345-0@lo:400: 00000100:00100000:1.0:1787781827.590987:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962929152:12345-0@lo:400: Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.590992:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781827.591011:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928384 00000100:00100000:1.0:1787781827.591015:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928384 00000100:00100000:1.0:1787781827.591031:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928896 00000100:00100000:1.0:1787781827.591033:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928896 00000100:00100000:1.0:1787781827.591044:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929408 00000100:00100000:1.0:1787781827.591046:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929408 00000100:00100000:1.0:1787781827.591056:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929024 00000100:00100000:1.0:1787781827.591058:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929024 00000100:00100000:1.0:1787781827.591068:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929536 00000100:00100000:1.0:1787781827.591070:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929536 00000100:00100000:1.0:1787781827.591080:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962928640 00000100:00100000:1.0:1787781827.591082:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962928640 00000100:00100000:1.0:1787781827.591094:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787781827.591100:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962928384:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591129:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962928384:12345-0@lo:400: Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591145:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787781827.591158:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787781827.591164:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962928896:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591192:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962928896:12345-0@lo:400: Request processed in 29us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591197:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787781827.591208:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787781827.591214:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962929408:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591254:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962929408:12345-0@lo:400: Request processed in 40us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591260:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787781827.591272:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781827.591278:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962929024:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591302:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962929024:12345-0@lo:400: Request processed in 25us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591308:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781827.591318:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787781827.591324:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962929536:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591349:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962929536:12345-0@lo:400: Request processed in 25us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591354:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787781827.591364:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787781827.591370:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962928640:12345-0@lo:400: 00000100:00100000:1.0:1787781827.591393:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962928640:12345-0@lo:400: Request processed in 23us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781827.591407:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787781827.591446:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781827.591450:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781827.591452:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781827.591483:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fe12c0 x1874624962928640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591496:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962928640:0@lo:400: 00010000:00080000:1.0:1787781827.591506:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43764780 x1874624962929152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591515:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962929152:0@lo:400: 00000100:00100000:1.0:1787781827.591523:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962928512:0@lo:400: 00010000:00080000:1.0:1787781827.591532:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43765a40 x1874624962929024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591540:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962929024:0@lo:400: 00010000:00080000:1.0:1787781827.591548:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43767840 x1874624962929536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591555:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962929536:0@lo:400: 00010000:00080000:1.0:1787781827.591589:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fe1e00 x1874624962928384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591598:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962928384:0@lo:400: 00010000:00080000:1.0:1787781827.591625:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c437652c0 x1874624962928896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591634:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962928896:0@lo:400: 00010000:00080000:1.0:1787781827.591653:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43764f00 x1874624962929408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591661:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962929408:0@lo:400: 00000100:00100000:1.0:1787781827.591670:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962928256:0@lo:400: 00000100:00100000:1.0:1787781827.591679:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962928768:0@lo:400: 00010000:00080000:1.0:1787781827.591687:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c437670c0 x1874624962929280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781827.591693:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962929280:0@lo:400: 00010000:00010000:1.0:1787781827.656144:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781828.108686:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781828.108708:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962929664:0@lo:41: 00000100:00100000:3.0:1787781828.108975:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787781828.110489:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787781828.110495:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d7236f800 from 39 10000000:01000000:0.0:1787781828.110499:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787781828.110536:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.110546:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.110557:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.110576:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962929792:0@lo:101: 00000100:00100000:0.0:1787781828.110638:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.110670:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929792 00000100:00100000:0.0:1787781828.110675:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929792 00000100:00100000:0.0:1787781828.110715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781828.110945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962929792:12345-0@lo:101: 00010000:00010000:0.0:1787781828.110959:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781828.110972:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506323f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.111064:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.111074:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.111083:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9a00, rc 0) 00000100:00100000:0.0:1787781828.111114:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962929792:12345-0@lo:101: Request processed in 173us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.111120:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781828.111156:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.111173:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962929792:0@lo:101: 00010000:00010000:0.0:1787781828.111186:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.111194:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.111247:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962929920:0@lo:501: 00000100:00100000:0.0:1787781828.111271:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.111291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929920 00000100:00100000:0.0:1787781828.111295:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929920 00000100:00100000:0.0:1787781828.111314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787781828.111320:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962929920:12345-0@lo:501: 00000100:00100000:0.0:1787781828.111860:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962929920:12345-0@lo:501: Request processed in 538us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.112237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787781828.112281:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.112297:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962929920:0@lo:501: 00000100:00100000:0.0:1787781828.112328:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930048:0@lo:503: 00000100:00100000:0.0:1787781828.112368:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.112837:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.112961:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930048 00000100:00100000:3.0:1787781828.112967:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930048 00000100:00100000:3.0:1787781828.113075:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787781828.113084:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962930048:12345-0@lo:503: 00000100:00100000:3.0:1787781828.113187:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962930048:12345-0@lo:503: Request processed in 104us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.113194:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787781828.113489:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930048:0@lo:503: 00000100:00100000:1.0:1787781828.113640:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962929664 00000100:00100000:1.0:1787781828.113646:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962929664 00000100:00100000:1.0:1787781828.113677:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787781828.113685:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962929664:12345-0@lo:41: 00000004:00000024:1.0:1787781828.113707:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1787781828.113840:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962929664:12345-0@lo:41: Request processed in 155us (4865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.113847:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787781828.113960:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962929664:0@lo:41: 00000100:00100000:3.0:1787781828.121716:0:9829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9829:1874624962930176:0@lo:502: 00000100:00100000:3.0:1787781828.121942:0:9829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.122051:0:9829:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cef480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.122215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930176 00000100:00100000:0.0:1787781828.122223:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930176 00000100:00100000:0.0:1787781828.122270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787781828.122279:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9829:x1874624962930176:12345-0@lo:502: 00000100:00100000:0.0:1787781828.122493:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9829:x1874624962930176:12345-0@lo:502: Request processed in 214us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.122501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787781828.122602:0:9829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9829:1874624962930176:0@lo:502: 00000100:00100000:1.0:1787781828.122664:0:9829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9829:1874624962930304:0@lo:502: 00000100:00100000:1.0:1787781828.122713:0:9829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.122813:0:9829:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.124095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930304 00000100:00100000:3.0:1787781828.124104:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930304 00000100:00100000:3.0:1787781828.124152:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787781828.124160:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9829:x1874624962930304:12345-0@lo:502: 00000100:00100000:3.0:1787781828.124285:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:9829:x1874624962930304:12345-0@lo:502: Request processed in 125us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.124292:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787781828.125696:0:9829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9829:1874624962930304:0@lo:502: 00000040:00080000:0.0:1787781828.125742:0:9829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787781828.125862:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787781828.125993:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781828.126003:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126014:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.126023:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787781828.126025:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787781828.126028:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787781828.126058:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126073:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126083:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.126099:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930432:0@lo:101: 00000100:00100000:0.0:1787781828.126142:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.126169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930432 00000100:00100000:0.0:1787781828.126173:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930432 00000100:00100000:0.0:1787781828.126204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787781828.126211:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962930432:12345-0@lo:101: 00010000:00010000:0.0:1787781828.126221:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781828.126232:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506324d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126252:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506324d expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126262:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506324d expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126270:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8800, rc 0) 00000100:00100000:0.0:1787781828.126293:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962930432:12345-0@lo:101: Request processed in 82us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.126299:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787781828.126330:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.126339:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930432:0@lo:101: 00010000:00010000:0.0:1787781828.126356:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.126364:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.126416:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930560:0@lo:501: 00000100:00100000:0.0:1787781828.126439:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.126455:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930560 00000100:00100000:0.0:1787781828.126458:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930560 00000100:00100000:0.0:1787781828.126475:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787781828.126480:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962930560:12345-0@lo:501: 00000100:00100000:0.0:1787781828.126568:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962930560:12345-0@lo:501: Request processed in 87us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.126575:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787781828.126592:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.126600:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930560:0@lo:501: 00000100:00100000:0.0:1787781828.126650:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930688:0@lo:503: 00000100:00100000:0.0:1787781828.126681:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.126695:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930688 00000100:00100000:0.0:1787781828.126698:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930688 00000100:00100000:0.0:1787781828.126714:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787781828.126953:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962930688:12345-0@lo:503: 00000100:00100000:0.0:1787781828.127067:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962930688:12345-0@lo:503: Request processed in 346us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.127073:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787781828.127105:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.127115:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962930688:0@lo:503: 00000100:00100000:0.0:1787781828.127265:0:9830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9830:1874624962930816:0@lo:502: 00000100:00100000:0.0:1787781828.127298:0:9830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.127315:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930816 00000100:00100000:0.0:1787781828.127318:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930816 00000100:00100000:0.0:1787781828.127336:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787781828.127340:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9830:x1874624962930816:12345-0@lo:502: 00000100:00100000:0.0:1787781828.127457:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9830:x1874624962930816:12345-0@lo:502: Request processed in 116us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.127464:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787781828.127490:0:9830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.127500:0:9830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9830:1874624962930816:0@lo:502: 00000020:01000000:0.0:1787781828.127520:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781828.127527:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781828.127529:0:9830:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781828.127534:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781828.127535:0:9830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787781828.127548:0:9830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9830:1874624962930944:0@lo:502: 00000100:00100000:0.0:1787781828.127575:0:9830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.127590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962930944 00000100:00100000:0.0:1787781828.127593:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962930944 00000100:00100000:0.0:1787781828.127627:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787781828.127632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9830:x1874624962930944:12345-0@lo:502: 00000100:00100000:0.0:1787781828.127681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:9830:x1874624962930944:12345-0@lo:502: Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.127687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787781828.127715:0:9830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.127863:0:9830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9830:1874624962930944:0@lo:502: 00000020:01000000:0.0:1787781828.127942:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781828.127946:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781828.127948:0:9830:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787781828.127951:0:9830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787781828.127999:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787781828.128014:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787781828.128022:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128030:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.128039:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787781828.128041:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d80a11800 from 39 10000000:01000000:0.0:1787781828.128044:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787781828.128064:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128072:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128080:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.128091:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931072:0@lo:101: 00000100:00100000:0.0:1787781828.128115:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.128137:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.128148:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931072 00000100:00100000:0.0:1787781828.128157:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931072 00000100:00100000:0.0:1787781828.128180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787781828.128186:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962931072:12345-0@lo:101: 00010000:00010000:0.0:1787781828.128194:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781828.128205:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506325b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128222:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506325b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128231:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506325b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128238:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781828.128266:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931072:12345-0@lo:101: Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.128271:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787781828.128301:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931072:0@lo:101: 00010000:00010000:0.0:1787781828.128310:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.128320:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.128355:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931200:0@lo:501: 00000100:00100000:0.0:1787781828.128392:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.128404:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.128414:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931200 00000100:00100000:0.0:1787781828.128418:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931200 00000100:00100000:0.0:1787781828.128444:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787781828.128450:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931200:12345-0@lo:501: 00000100:00100000:0.0:1787781828.128534:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931200:12345-0@lo:501: Request processed in 83us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.128540:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787781828.128568:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931200:0@lo:501: 00000100:00100000:0.0:1787781828.128592:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931328:0@lo:503: 00000100:00100000:0.0:1787781828.128644:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.128656:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.128667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931328 00000100:00100000:0.0:1787781828.128670:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931328 00000100:00100000:0.0:1787781828.128689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787781828.128694:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931328:12345-0@lo:503: 00000100:00100000:0.0:1787781828.129995:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931328:12345-0@lo:503: Request processed in 1287us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.130004:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787781828.130057:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931328:0@lo:503: 00000100:00100000:1.0:1787781828.132693:0:9831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9831:1874624962931456:0@lo:502: 00000100:00100000:1.0:1787781828.133078:0:9831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.133119:0:9831:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.133189:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931456 00000100:00100000:0.0:1787781828.133196:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931456 00000100:00100000:0.0:1787781828.133244:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787781828.133253:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:9831:x1874624962931456:12345-0@lo:502: 00000100:00100000:0.0:1787781828.133358:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:9831:x1874624962931456:12345-0@lo:502: Request processed in 105us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.133364:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787781828.133530:0:9831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9831:1874624962931456:0@lo:502: 00000100:00100000:1.0:1787781828.133576:0:9831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9831:1874624962931584:0@lo:502: 00000100:00100000:1.0:1787781828.133809:0:9831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.133848:0:9831:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.133950:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931584 00000100:00100000:0.0:1787781828.133955:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931584 00000100:00100000:0.0:1787781828.134060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787781828.134069:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:9831:x1874624962931584:12345-0@lo:502: 00000100:00100000:0.0:1787781828.134154:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:9831:x1874624962931584:12345-0@lo:502: Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.134161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787781828.134499:0:9831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9831:1874624962931584:0@lo:502: 00000040:00080000:1.0:1787781828.134530:0:9831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787781828.134959:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787781828.134981:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781828.135059:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.135070:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.135079:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787781828.135082:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d80a11800 from 6 10000000:01000000:0.0:1787781828.135084:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787781828.135116:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.135124:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.135133:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.135148:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931712:0@lo:101: 00000100:00100000:0.0:1787781828.135188:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.135211:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d497033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.135626:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931712 00000100:00100000:1.0:1787781828.135633:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931712 00000100:00100000:1.0:1787781828.135673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787781828.135680:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962931712:12345-0@lo:101: 00010000:00010000:1.0:1787781828.135690:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.135704:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038600/0xc6d6745c15063270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063269 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.136046:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038600/0xc6d6745c15063270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063269 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.136061:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038600/0xc6d6745c15063270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063269 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.136070:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038600, rc 0) 00000100:00100000:1.0:1787781828.136167:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962931712:12345-0@lo:101: Request processed in 487us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.136174:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787781828.145062:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931712:0@lo:101: 00010000:00010000:3.0:1787781828.145092:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.145106:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.145179:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931840:0@lo:256: 00000100:00100000:3.0:1787781828.145246:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.145283:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.146238:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931840 00000100:00100000:1.0:1787781828.146253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931840 00000100:00100000:1.0:1787781828.146301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787781828.146310:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962931840:12345-0@lo:256: 20000000:01000000:1.0:1787781828.146331:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787781828.146348:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787781828.146351:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787781828.146445:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962931840:12345-0@lo:256: Request processed in 136us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.146453:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787781828.146499:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931840:0@lo:256: 10000000:01000000:1.0:1787781828.146545:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787781828.146554:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146564:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781828.146573:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787781828.146575:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787781828.146578:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787781828.146603:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146630:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146638:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.146653:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931968:0@lo:101: 00000100:00100000:1.0:1787781828.146687:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.146704:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.146732:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962931968 00000100:00100000:1.0:1787781828.146737:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962931968 00000100:00100000:1.0:1787781828.146762:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787781828.146768:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962931968:12345-0@lo:101: 00010000:00010000:1.0:1787781828.146776:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.146790:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063277 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146808:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063277 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146818:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063277 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.146836:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038400, rc 0) 00000100:00100000:1.0:1787781828.152477:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962931968:12345-0@lo:101: Request processed in 98us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.152491:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787781828.152580:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962931968:0@lo:101: 00010000:00010000:1.0:1787781828.152602:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.152628:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.152702:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962932096:0@lo:501: 00000100:00100000:1.0:1787781828.152776:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.152819:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.153980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932096 00000100:00100000:3.0:1787781828.154451:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932096 00000100:00100000:3.0:1787781828.154506:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787781828.154515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962932096:12345-0@lo:501: 00000100:00100000:3.0:1787781828.154848:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962932096:12345-0@lo:501: Request processed in 333us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.154855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787781828.154951:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962932096:0@lo:501: 00000100:00100000:1.0:1787781828.155760:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962932224:0@lo:503: 00000100:00100000:1.0:1787781828.155820:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.155862:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.156118:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932224 00000100:00100000:3.0:1787781828.156124:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932224 00000100:00100000:3.0:1787781828.156163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787781828.156171:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962932224:12345-0@lo:503: 00000100:00100000:3.0:1787781828.156269:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962932224:12345-0@lo:503: Request processed in 98us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.156276:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787781828.158121:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962932224:0@lo:503: 00000100:00100000:1.0:1787781828.158924:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9834:1874624962932352:0@lo:502: 00000100:00100000:1.0:1787781828.159449:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.159491:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932352 00000100:00100000:1.0:1787781828.159497:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932352 00000100:00100000:1.0:1787781828.159534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787781828.159541:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:9834:x1874624962932352:12345-0@lo:502: 00000100:00100000:1.0:1787781828.159667:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:9834:x1874624962932352:12345-0@lo:502: Request processed in 126us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.159676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787781828.159717:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.159807:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9834:1874624962932352:0@lo:502: 00000020:01000000:1.0:1787781828.159847:0:9834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787781828.159854:0:9834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787781828.159860:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781828.159862:0:9834:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787781828.159931:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787781828.159935:0:9834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:1.0:1787781828.159955:0:9834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787781828.159957:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781828.160048:0:9834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff993c437e0000) 00000020:00000080:1.0:1787781828.160073:0:9834:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787781828.160080:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787781828.160164:0:9834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787781828.160170:0:9834:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787781828.160177:0:9834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c1506328c 00010000:00080000:1.0:1787781828.160203:0:9834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c437f1000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787781828.161844:0:9834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787781828.161980:0:9834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787781828.162059:0:9834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787781828.162218:0:9834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781828.162309:0:9834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781828.162444:0:9834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787781828.162518:0:9834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787781828.163113:0:9835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781828.163119:0:9835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787781828.163787:0:9834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787781828.163800:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787781828.163854:0:9834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787781828.163880:0:9834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15063293 00000100:00080000:3.0:1787781828.163896:0:9834:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781828.163903:0:9834:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993c437f1000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787781828.163937:0:9834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c426921c0 x1874624962932480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787781828.163960:0:9834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787781828.164147:0:9834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781828.164151:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.164153:0:9834:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787781828.164156:0:9834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781828.164160:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.164161:0:9834:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787781828.164164:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787781828.164166:0:9834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787781828.164193:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9834:1874624962932608:0@lo:502: 00000100:00100000:3.0:1787781828.164268:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.164302:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.164375:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962932480:0@lo:8: 00000100:00100000:1.0:1787781828.164481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.164530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932608 00000100:00100000:1.0:1787781828.164538:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932608 00000100:00100000:1.0:1787781828.164576:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787781828.164585:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:9834:x1874624962932608:12345-0@lo:502: 00000100:00100000:1.0:1787781828.164712:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:9834:x1874624962932608:12345-0@lo:502: Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.164781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787781828.165208:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962932736:0@lo:400: 00000100:00100000:1.0:1787781828.165240:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165261:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962933248:0@lo:400: 00000100:00100000:1.0:1787781828.165282:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165299:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962933760:0@lo:400: 00000100:00100000:1.0:1787781828.165331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165351:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787781828.165357:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962932864:0@lo:400: 00000100:00100000:1.0:1787781828.165389:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165400:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962933376:0@lo:400: 00000100:00100000:1.0:1787781828.165419:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165443:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962932992:0@lo:400: 00000100:00100000:1.0:1787781828.165466:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165480:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962933504:0@lo:400: 00000100:00100000:1.0:1787781828.165495:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165507:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787781828.165512:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962933120:0@lo:400: 00000100:00100000:1.0:1787781828.165527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165534:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962933632:0@lo:400: 00000100:00100000:1.0:1787781828.165550:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.165569:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932736 00000100:00100000:1.0:1787781828.165573:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932736 00000100:00100000:1.0:1787781828.165595:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933248 00000100:00100000:1.0:1787781828.165597:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933248 00000100:00100000:1.0:1787781828.165628:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933760 00000100:00100000:1.0:1787781828.165630:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933760 00000100:00100000:1.0:1787781828.165640:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932864 00000100:00100000:1.0:1787781828.165642:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932864 00000100:00100000:1.0:1787781828.165650:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933120 00000100:00100000:1.0:1787781828.165652:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933120 00000100:00100000:1.0:1787781828.165661:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933632 00000100:00100000:1.0:1787781828.165663:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933632 00000100:00100000:1.0:1787781828.165674:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787781828.165680:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962932736:12345-0@lo:400: 00000100:00100000:3.0:1787781828.165891:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932480 00000100:00100000:3.0:1787781828.165896:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932480 00000100:00100000:3.0:1787781828.165915:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933376 00000100:00100000:3.0:1787781828.165918:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933376 00000100:00100000:3.0:1787781828.165934:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933504 00000100:00100000:3.0:1787781828.165937:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933504 00000100:00100000:3.0:1787781828.165950:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781828.165956:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962933376:12345-0@lo:400: 00000100:00100000:3.0:1787781828.166002:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962933376:12345-0@lo:400: Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.166008:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781828.166022:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.166028:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962933504:12345-0@lo:400: 00000100:00100000:3.0:1787781828.166072:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962933504:12345-0@lo:400: Request processed in 44us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.166079:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.166091:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.166095:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624962932480:12345-0@lo:8: 00010000:00080000:3.0:1787781828.166118:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1787781828.166144:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c1506329a 00002000:00100000:3.0:1787781828.166157:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff993c426aa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787781828.166161:0:8445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787781828.166164:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787781828.166220:0:8445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787781828.166452:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787781828.166475:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c426ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781828.166517:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624962932480:12345-0@lo:8: Request processed in 421us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.166524:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.166562:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9834:1874624962932608:0@lo:502: 00000020:01000000:3.0:1787781828.166596:0:9834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781828.166603:0:9834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.166604:0:9834:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787781828.166626:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1787781828.166679:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1787781828.166700:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787781828.166709:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.166733:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781828.166751:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787781828.166753:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d47267800 from 39 10000000:01000000:3.0:1787781828.166755:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781828.166781:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.166789:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.166796:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.166811:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962933888:0@lo:101: 00000100:00100000:3.0:1787781828.166852:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.166876:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.167182:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962932736:12345-0@lo:400: Request processed in 1499us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167190:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787781828.167211:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787781828.167220:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962933248:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167253:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962933248:12345-0@lo:400: Request processed in 36us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167258:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787781828.167270:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787781828.167277:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962933760:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167304:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962933760:12345-0@lo:400: Request processed in 28us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167309:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787781828.167321:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787781828.167328:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962932864:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167356:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962932864:12345-0@lo:400: Request processed in 29us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167361:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787781828.167435:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787781828.167445:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962933120:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167475:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962933120:12345-0@lo:400: Request processed in 33us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167484:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787781828.167497:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787781828.167504:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962933632:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167541:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962933632:12345-0@lo:400: Request processed in 39us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167547:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787781828.167587:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962932992 00000100:00100000:1.0:1787781828.167592:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962932992 00000100:00100000:1.0:1787781828.167650:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781828.167657:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962932992:12345-0@lo:400: 00000100:00100000:1.0:1787781828.167690:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962932992:12345-0@lo:400: Request processed in 35us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167696:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781828.167792:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962933888 00000100:00100000:1.0:1787781828.167797:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962933888 00000100:00100000:1.0:1787781828.167823:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787781828.167841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962933888:12345-0@lo:101: 00010000:00010000:1.0:1787781828.167850:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.167866:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150632a1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.167888:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.167898:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.167906:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039600, rc 0) 00000100:00100000:1.0:1787781828.167940:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962933888:12345-0@lo:101: Request processed in 99us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.167946:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:1.0:1787781828.168084:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c426921c0 x1874624962932480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.168095:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781828.168103:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787781828.168111:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787781828.168117:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787781828.168120:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c437f1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787781828.168134:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787781828.168140:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624962932480:0@lo:8: 00010000:00080000:1.0:1787781828.168170:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4000 x1874624962933120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.168180:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962933120:0@lo:400: 00010000:00080000:1.0:1787781828.168190:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a5e00 x1874624962933632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.168198:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962933632:0@lo:400: 00000100:00100000:1.0:1787781828.168207:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962932992:0@lo:400: 00010000:00080000:1.0:1787781828.168217:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a52c0 x1874624962933504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.168225:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962933504:0@lo:400: 00000100:00100000:1.0:1787781828.168253:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962933888:0@lo:101: 00010000:00010000:1.0:1787781828.168266:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.168275:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.168340:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934016:0@lo:501: 00000100:00100000:1.0:1787781828.168368:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.168547:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934016 00000100:00100000:0.0:1787781828.168552:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934016 00000100:00100000:0.0:1787781828.168582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787781828.168588:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962934016:12345-0@lo:501: 00000004:00080000:2.0:1787781828.169067:0:9835:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787781828.169128:0:9835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 265250520514ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787781828.169134:0:9835:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1787781828.169206:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a6940 x1874624962932864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.169218:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962932864:0@lo:400: 00010000:00080000:2.0:1787781828.169229:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a7480 x1874624962933376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.169236:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962933376:0@lo:400: 00010000:00080000:2.0:1787781828.169250:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a61c0 x1874624962932736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.169257:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962932736:0@lo:400: 00010000:00080000:2.0:1787781828.169270:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a6580 x1874624962933248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.169278:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962933248:0@lo:400: 00010000:00080000:2.0:1787781828.169290:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4b40 x1874624962933760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.169297:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962933760:0@lo:400: 00000004:00080000:3.0:1787781828.171362:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787781828.171549:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962934016:12345-0@lo:501: Request processed in 2956us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.171561:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787781828.174030:0:9836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962934144:0@lo:700: 00000100:00100000:0.0:1787781828.174099:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.174131:0:9836:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.177960:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.178010:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934016:0@lo:501: 00000100:00100000:1.0:1787781828.178071:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934272:0@lo:503: 00000100:00100000:1.0:1787781828.178135:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.178159:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.178180:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934144 00000100:00100000:1.0:1787781828.178186:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934144 00000100:00100000:1.0:1787781828.178241:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781828.178251:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9836:x1874624962934144:12345-0@lo:700: 00000100:00100000:1.0:1787781828.178286:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8454:1874624962934400:0@lo:700: 00000100:00100000:1.0:1787781828.178324:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.178344:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.178358:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934272 00000100:00100000:1.0:1787781828.178361:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934272 00000100:00100000:1.0:1787781828.178388:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787781828.178396:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962934272:12345-0@lo:503: 00000100:00100000:1.0:1787781828.178499:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962934272:12345-0@lo:503: Request processed in 104us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.178507:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1787781828.178546:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781828.178560:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934400 00000100:00100000:1.0:1787781828.178563:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934400 00000100:00100000:1.0:1787781828.178586:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781828.178600:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8454:x1874624962934400:12345-0@lo:700: 00000100:00100000:1.0:1787781828.178753:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934272:0@lo:503: 00000100:00100000:1.0:1787781828.178960:0:9837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9837:1874624962934528:0@lo:502: 00000100:00100000:1.0:1787781828.178995:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.182304:0:9837:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.182358:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934528 00000100:00100000:0.0:1787781828.182368:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934528 00000100:00100000:0.0:1787781828.182422:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787781828.182432:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:9837:x1874624962934528:12345-0@lo:502: 00000100:00100000:0.0:1787781828.182565:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:9837:x1874624962934528:12345-0@lo:502: Request processed in 134us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.182573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787781828.182715:0:9837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9837:1874624962934528:0@lo:502: 00000100:00100000:1.0:1787781828.182784:0:9837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9837:1874624962934656:0@lo:502: 00000100:00100000:1.0:1787781828.182823:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.182854:0:9837:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.182947:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934656 00000100:00100000:0.0:1787781828.182952:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934656 00000100:00100000:0.0:1787781828.182981:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787781828.182998:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:9837:x1874624962934656:12345-0@lo:502: 00000100:00100000:0.0:1787781828.183064:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:9837:x1874624962934656:12345-0@lo:502: Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.183071:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787781828.183202:0:9837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9837:1874624962934656:0@lo:502: 00000040:00080000:1.0:1787781828.183221:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787781828.183364:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787781828.183388:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781828.183398:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.183420:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.183429:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787781828.183431:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d47267800 from 6 10000000:01000000:0.0:1787781828.183434:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787781828.183458:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.183465:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.183472:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.183484:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934784:0@lo:101: 00000100:00100000:0.0:1787781828.183512:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.183542:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.183586:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934784 00000100:00100000:1.0:1787781828.183590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934784 00000100:00100000:1.0:1787781828.183642:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787781828.183649:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962934784:12345-0@lo:101: 00010000:00010000:1.0:1787781828.183658:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.183671:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039e00/0xc6d6745c150632b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150632af expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.183690:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039e00/0xc6d6745c150632b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150632af expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.183701:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039e00/0xc6d6745c150632b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632af expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.183709:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039e00, rc 0) 00000100:00100000:1.0:1787781828.183814:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962934784:12345-0@lo:101: Request processed in 165us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.183844:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787781828.184089:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934784:0@lo:101: 00010000:00010000:1.0:1787781828.184101:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184110:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.184151:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934912:0@lo:256: 00000100:00100000:1.0:1787781828.184179:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.184193:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.184204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962934912 00000100:00100000:1.0:1787781828.184208:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962934912 00000100:00100000:1.0:1787781828.184230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787781828.184237:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962934912:12345-0@lo:256: 20000000:01000000:1.0:1787781828.184248:0:6523:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787781828.184264:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787781828.184267:0:6523:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787781828.184340:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962934912:12345-0@lo:256: Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.184347:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787781828.184377:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962934912:0@lo:256: 10000000:01000000:1.0:1787781828.184416:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787781828.184421:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184436:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781828.184443:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787781828.184445:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787781828.184447:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787781828.184463:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184469:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184477:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.184488:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935040:0@lo:101: 00000100:00100000:1.0:1787781828.184512:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.184525:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.184536:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935040 00000100:00100000:1.0:1787781828.184539:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935040 00000100:00100000:1.0:1787781828.184557:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787781828.184562:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962935040:12345-0@lo:101: 00010000:00010000:1.0:1787781828.184568:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.184576:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150632bd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184589:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150632bd expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184628:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632bd expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184635:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039400, rc 0) 00000100:00100000:1.0:1787781828.184660:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935040:12345-0@lo:101: Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.184665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787781828.184689:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935040:0@lo:101: 00010000:00010000:1.0:1787781828.184698:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.184704:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.185184:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935168:0@lo:501: 00000100:00100000:1.0:1787781828.185211:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.185241:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.185282:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935168 00000100:00100000:0.0:1787781828.185286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935168 00000100:00100000:0.0:1787781828.185319:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787781828.185325:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935168:12345-0@lo:501: 00000100:00100000:0.0:1787781828.185411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935168:12345-0@lo:501: Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.185417:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787781828.185473:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935168:0@lo:501: 00000100:00100000:1.0:1787781828.185496:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935296:0@lo:503: 00000100:00100000:1.0:1787781828.185530:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.185550:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.185585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935296 00000100:00100000:0.0:1787781828.185589:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935296 00000100:00100000:0.0:1787781828.185635:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787781828.185649:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935296:12345-0@lo:503: 00000100:00100000:0.0:1787781828.185714:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935296:12345-0@lo:503: Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.185822:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935296:0@lo:503: 00000100:00100000:0.0:1787781828.185956:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 40000000:02000000:1.0:1787781828.191097:0:6539:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787781828.191915:0:9838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9838:1874624962935424:0@lo:502: 00000100:00100000:0.0:1787781828.192851:0:9838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.192898:0:9838:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.198150:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8454:x1874624962934400:12345-0@lo:700: Request processed in 19544us (19818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.198174:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787781828.198229:0:8454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fe12c0 x1874624962934400/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.198243:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8454:1874624962934400:0@lo:700: 40000000:02000000:1.0:1787781828.198255:0:8454:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1787781828.203647:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935424 00000100:00100000:1.0:1787781828.203659:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935424 00000100:00100000:1.0:1787781828.203704:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787781828.203712:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:9838:x1874624962935424:12345-0@lo:502: 00000001:00100000:3.0:1787781828.205857:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787781828.206025:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962934144:12345-0@lo:700: Request processed in 27771us (31921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.206036:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787781828.206080:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0ea580 x1874624962934144/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.206093:0:9836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962934144:0@lo:700: 00000100:00100000:1.0:1787781828.206459:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:9838:x1874624962935424:12345-0@lo:502: Request processed in 2745us (13609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.206468:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787781828.206574:0:9838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9838:1874624962935424:0@lo:502: 00000020:01000000:0.0:1787781828.206602:0:9838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787781828.206795:0:9838:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787781828.210056:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781828.210063:0:9838:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787781828.210075:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787781828.210081:0:9838:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:1.0:1787781828.210108:0:9838:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787781828.210112:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781828.210126:0:9838:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff993c437e19b8) 00000020:00000080:1.0:1787781828.210152:0:9838:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1787781828.210158:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787781828.210268:0:9838:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787781828.210274:0:9838:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787781828.210289:0:9838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c150632d2 00010000:00080000:1.0:1787781828.210319:0:9838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c43c28800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787781828.210804:0:9838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1787781828.210950:0:9838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787781828.210967:0:9838:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787781828.211234:0:9838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781828.211346:0:9838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781828.211818:0:9838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787781828.211924:0:9838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787781828.214195:0:9839:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781828.214202:0:9839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787781828.219207:0:9838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787781828.219220:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787781828.219260:0:9838:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787781828.219284:0:9838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c150632d9 00000100:00080000:2.0:1787781828.219294:0:9838:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781828.219300:0:9838:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff993c43c28800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787781828.219332:0:9838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4b40 x1874624962935552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787781828.219457:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962935552:0@lo:8: 00000100:00100000:1.0:1787781828.219521:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787781828.219580:0:9838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787781828.219656:0:9838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781828.219661:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781828.219662:0:9838:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787781828.219665:0:9838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781828.219669:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781828.219670:0:9838:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787781828.219673:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787781828.219675:0:9838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787781828.219698:0:9838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9838:1874624962935680:0@lo:502: 00000100:00100000:2.0:1787781828.219757:0:9838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.219775:0:9838:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781828.219808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935680 00000100:00100000:2.0:1787781828.219814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935680 00000100:00100000:2.0:1787781828.219861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787781828.219869:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:9838:x1874624962935680:12345-0@lo:502: 00000100:00100000:2.0:1787781828.219980:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:9838:x1874624962935680:12345-0@lo:502: Request processed in 111us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781828.221165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787781828.221242:0:9838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:9838:1874624962935680:0@lo:502: 00000020:01000000:2.0:1787781828.221273:0:9838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781828.221279:0:9838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781828.221282:0:9838:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787781828.221285:0:9838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1787781828.223574:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935552 00000100:00100000:1.0:1787781828.223586:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935552 00000100:00100000:1.0:1787781828.223634:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787781828.223641:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624962935552:12345-0@lo:8: 00010000:00080000:1.0:1787781828.223672:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1787781828.223697:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c150632e0 00002000:00100000:1.0:1787781828.223710:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff993c43c2d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787781828.223714:0:8445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787781828.223716:0:8445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787781828.223799:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787781828.223822:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c43c2b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781828.223908:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624962935552:12345-0@lo:8: Request processed in 266us (4386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.223916:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1787781828.223936:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1787781828.223962:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787781828.223971:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.223981:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781828.224166:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787781828.224169:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993d588099b8 from 1 10000000:01000000:1.0:1787781828.224171:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781828.224200:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.224209:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.224217:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.224236:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935808:0@lo:101: 00000100:00100000:1.0:1787781828.224272:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.224310:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05480 going to sleep for 11 seconds 00010000:00080000:1.0:1787781828.224340:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4b40 x1874624962935552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.224350:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781828.224358:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787781828.224364:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787781828.224369:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787781828.224372:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c43c28800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787781828.224460:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935808 00000100:00100000:3.0:1787781828.224465:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935808 00000100:00100000:3.0:1787781828.224495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787781828.224501:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962935808:12345-0@lo:101: 00010000:00010000:3.0:1787781828.224511:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781828.224523:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150632e7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.224544:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.224560:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.224569:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166200, rc 0) 00000100:00100000:3.0:1787781828.224598:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962935808:12345-0@lo:101: Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.224630:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:1.0:1787781828.224696:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787781828.224701:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624962935552:0@lo:8: 00000004:00080000:3.0:1787781828.224792:0:9839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787781828.224856:0:9839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 265306247933ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787781828.224861:0:9839:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787781828.224904:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935808:0@lo:101: 00010000:00010000:1.0:1787781828.224917:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.224933:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781828.225007:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935936:0@lo:501: 00000100:00100000:1.0:1787781828.225033:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781828.225321:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781828.227837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962935936 00000100:00100000:2.0:1787781828.227852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962935936 00000004:00080000:2.0:1787781828.229328:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787781828.229538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787781828.229556:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962935936:12345-0@lo:501: 00000100:00100000:3.0:1787781828.229748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962935936:12345-0@lo:501: Request processed in 199us (4713us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787781828.229756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787781828.229867:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962935936:0@lo:501: 10000000:01000000:2.0:1787781828.229911:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787781828.229922:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.229945:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781828.230220:0:9836:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787781828.230243:0:9836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936192:0@lo:7: 00000100:00100000:0.0:1787781828.230282:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.230304:0:9836:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.230318:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962936064:0@lo:13: 00000100:00100000:0.0:1787781828.230343:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.230390:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936192 00000100:00100000:0.0:1787781828.230396:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936192 00000100:00100000:0.0:1787781828.230432:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781828.230439:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962936192:12345-0@lo:7: 00002000:00080000:0.0:1787781828.236927:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787781828.236935:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787781828.237120:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962936192:12345-0@lo:7: Request processed in 6676us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.237132:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787781828.237184:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0ea580 x1874624962936192/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.237199:0:9836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936192:0@lo:7: 00000004:00080000:0.0:1787781828.237213:0:9836:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787781828.237248:0:9836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936320:0@lo:5: 00000100:00100000:0.0:1787781828.237278:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.237348:0:9836:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.237367:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936064 00000100:00100000:0.0:1787781828.237373:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936064 00000100:00100000:0.0:1787781828.237480:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781828.237489:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962936064:12345-0@lo:13: 00002000:00000024:0.0:1787781828.237509:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1787781828.237547:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962936064:12345-0@lo:13: Request processed in 59us (7203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.237553:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787781828.238642:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936320 00000100:00100000:3.0:1787781828.238653:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936320 00000100:00100000:3.0:1787781828.238690:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787781828.238698:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962936320:12345-0@lo:5: 00002000:00080000:3.0:1787781828.238731:0:8445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787781828.238783:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962936320:12345-0@lo:5: Request processed in 86us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.238789:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:3.0:1787781828.239501:0:9840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787781828.239523:0:9840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962936576:0@lo:7: 00000100:00100000:3.0:1787781828.239567:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.239625:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936576 00000100:00100000:3.0:1787781828.239630:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936576 00000100:00100000:3.0:1787781828.239667:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787781828.239674:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9840:x1874624962936576:12345-0@lo:7: 00000100:00100000:1.0:1787781828.239834:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962936448:0@lo:13: 00000100:00100000:1.0:1787781828.239867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787781828.239904:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781828.239914:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936448 00000100:00100000:1.0:1787781828.239918:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936448 00000100:00100000:1.0:1787781828.239938:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787781828.239944:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624962936448:12345-0@lo:13: 00002000:00000024:1.0:1787781828.239956:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1787781828.240069:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624962936448:12345-0@lo:13: Request processed in 124us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.240077:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787781828.240111:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42692940 x1874624962936448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.240128:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962936448:0@lo:13: 00010000:00080000:0.0:1787781828.245067:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bea8000 x1874624962936064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.245092:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962936064:0@lo:13: 00010000:00080000:0.0:1787781828.245132:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d461c0 x1874624962936320/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.245141:0:9836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936320:0@lo:5: 00000004:00080000:0.0:1787781828.245159:0:9836:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787781828.245196:0:9836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936704:0@lo:5: 00000100:00100000:0.0:1787781828.245249:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.245271:0:9836:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.245287:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936704 00000100:00100000:0.0:1787781828.245291:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936704 00000100:00100000:0.0:1787781828.245326:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787781828.245333:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9836:x1874624962936704:12345-0@lo:5: 00002000:00080000:0.0:1787781828.245364:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787781828.246906:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9836:x1874624962936704:12345-0@lo:5: Request processed in 1568us (1652us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787781828.246918:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787781828.246957:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d461c0 x1874624962936704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.246972:0:9836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1874624962936704:0@lo:5: 00000004:00080000:0.0:1787781828.246983:0:9836:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787781828.247017:0:9836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9836:1874624962936832:0@lo:900: 00000100:00100000:0.0:1787781828.247045:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.247067:0:9836:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50c6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.247087:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936832 00000100:00100000:0.0:1787781828.247092:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936832 00000100:00100000:0.0:1787781828.247122:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781828.247129:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9836:x1874624962936832:12345-0@lo:900: 00000100:00100000:0.0:1787781828.247170:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9836:x1874624962936832:12345-0@lo:900: Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.247186:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787781828.247217:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d44f00 x1874624962936832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.247226:0:9836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9836:1874624962936832:0@lo:900: 00002000:00080000:3.0:1787781828.249573:0:8445:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787781828.249581:0:8445:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787781828.249689:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9840:x1874624962936576:12345-0@lo:7: Request processed in 10012us (10117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.249700:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787781828.249806:0:9840:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7840 going to sleep for 11 seconds 00010000:00080000:3.0:1787781828.249839:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42693480 x1874624962936576/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781828.249852:0:9840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962936576:0@lo:7: 00000004:00080000:3.0:1787781828.249864:0:9840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787781828.249897:0:9840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962936960:0@lo:5: 00000100:00100000:3.0:1787781828.249929:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.249951:0:9840:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51900 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.250119:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962936960 00000100:00100000:0.0:1787781828.250126:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962936960 00000100:00100000:0.0:1787781828.250175:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781828.250184:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9840:x1874624962936960:12345-0@lo:5: 00002000:00080000:0.0:1787781828.250210:0:8638:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787781828.250213:0:8638:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1787781828.254636:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1787781828.254653:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787781828.254660:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787781828.254856:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9840:x1874624962936960:12345-0@lo:5: Request processed in 4669us (4922us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787781828.254867:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787781828.255019:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42693480 x1874624962936960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781828.255030:0:9840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787781828.255036:0:9840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962936960:0@lo:5: 00000004:00080000:3.0:1787781828.255049:0:9840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787781828.255091:0:9840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962937088:0@lo:700: 00000100:00100000:3.0:1787781828.255136:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.255165:0:9840:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.255275:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937088 00000100:00100000:1.0:1787781828.255281:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937088 00000100:00100000:1.0:1787781828.255320:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781828.255335:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9840:x1874624962937088:12345-0@lo:700: 00000100:00100000:2.0:1787781828.264574:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9840:x1874624962937088:12345-0@lo:700: Request processed in 9233us (9430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781828.264592:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787781828.264737:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42693480 x1874624962937088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781828.264752:0:9840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962937088:0@lo:700: 00000004:02000040:3.0:1787781828.266275:0:9840:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787781828.270698:0:9840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962937216:0@lo:5: 00000100:00100000:3.0:1787781828.270946:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.271122:0:9840:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.271189:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937216 00000100:00100000:1.0:1787781828.271197:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937216 00000100:00100000:1.0:1787781828.271248:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781828.271257:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9840:x1874624962937216:12345-0@lo:5: 00002000:00080000:3.0:1787781828.293409:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787781828.293429:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787781828.296364:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9840:x1874624962937216:12345-0@lo:5: Request processed in 25102us (25413us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787781828.296391:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787781828.300937:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42693480 x1874624962937216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.301444:0:9840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9840:1874624962937216:0@lo:5: 00000004:00080000:2.0:1787781828.301461:0:9840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1787781828.677875:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781828.994139:0:9894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787781829.128920:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962937472:0@lo:13: 00000100:00100000:2.0:1787781829.128983:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781829.129510:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962937344:0@lo:13: 00000100:00100000:1.0:1787781829.129548:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781829.129599:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937472 00000100:00100000:1.0:1787781829.129620:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937472 00000100:00100000:1.0:1787781829.129663:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937344 00000100:00100000:1.0:1787781829.129667:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937344 00000100:00100000:1.0:1787781829.129687:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787781829.129697:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962937472:12345-0@lo:13: 00002000:00000024:1.0:1787781829.129725:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781829.129769:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962937472:12345-0@lo:13: Request processed in 73us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781829.129775:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787781829.129791:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781829.129799:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962937344:12345-0@lo:13: 00002000:00000024:1.0:1787781829.129838:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781829.129874:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962937344:12345-0@lo:13: Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781829.129880:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787781829.129903:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781829.129934:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a6d00 x1874624962937472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781829.129964:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962937472:0@lo:13: 00010000:00080000:1.0:1787781829.130002:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d44f00 x1874624962937344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781829.130013:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962937344:0@lo:13: 00010000:00010000:2.0:1787781829.701757:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787781829.830648:0:9946:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781829.831129:0:9946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787781830.726702:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787781830.850794:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787781831.174853:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962937600:0@lo:41: 00000100:00100000:2.0:1787781831.174939:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781831.175131:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937600 00000100:00100000:1.0:1787781831.175139:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937600 00000100:00100000:1.0:1787781831.175208:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781831.175218:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962937600:12345-0@lo:41: 00000004:00000024:1.0:1787781831.175255:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781831.181064:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962937600:12345-0@lo:41: Request processed in 5838us (6115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781831.181080:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787781831.181252:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962937600:0@lo:41: 00010000:00010000:2.0:1787781831.749852:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781832.775466:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787781833.054423:0:10048:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781833.055877:0:10048:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787781833.228908:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962937984:0@lo:400: 00000100:00100000:0.0:1787781833.230105:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.230216:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937984 00000100:00100000:0.0:1787781833.230226:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937984 00000100:00100000:0.0:1787781833.230287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781833.230298:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962937984:12345-0@lo:400: 00000100:00100000:0.0:1787781833.230439:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962937984:12345-0@lo:400: Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.230448:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781833.230498:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962937984:0@lo:400: 00000100:00100000:0.0:1787781833.230555:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962938112:0@lo:400: 00000100:00100000:0.0:1787781833.230589:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.230671:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781833.230693:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962938496:0@lo:400: 00000100:00100000:0.0:1787781833.230719:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.230761:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962938624:0@lo:400: 00000100:00100000:0.0:1787781833.230788:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.230838:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938624 00000100:00100000:0.0:1787781833.230842:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938624 00000100:00100000:0.0:1787781833.230886:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781833.230893:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962938624:12345-0@lo:400: 00000100:00100000:0.0:1787781833.230932:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962938624:12345-0@lo:400: Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.230939:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787781833.233669:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd8000 x1874624962938624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.233691:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962938624:0@lo:400: 00000100:00100000:0.0:1787781833.233855:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962939008:0@lo:400: 00000100:00100000:0.0:1787781833.233937:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.233998:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781833.234004:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962939136:0@lo:400: 00000100:00100000:0.0:1787781833.234032:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.234739:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938112 00000100:00100000:0.0:1787781833.234748:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938112 00000100:00100000:0.0:1787781833.234892:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938496 00000100:00100000:0.0:1787781833.234896:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938496 00000100:00100000:0.0:1787781833.234916:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939008 00000100:00100000:0.0:1787781833.234918:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939008 00000100:00100000:0.0:1787781833.234934:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787781833.234944:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962938112:12345-0@lo:400: 00000100:00100000:1.0:1787781833.235255:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787781833.235265:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1787781833.235287:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781833.235292:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781833.235304:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939136 00000100:00100000:1.0:1787781833.235308:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939136 00000100:00100000:1.0:1787781833.235464:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787781833.235472:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962939136:12345-0@lo:400: 00000100:00100000:1.0:1787781833.235652:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962939136:12345-0@lo:400: Request processed in 180us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.235659:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787781833.235689:0:6532:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787781833.235697:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781833.235704:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962938496:12345-0@lo:400: 00000100:00100000:1.0:1787781833.235890:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962938496:12345-0@lo:400: Request processed in 187us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.235897:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787781833.235910:0:6532:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787781833.235916:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787781833.235922:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962939008:12345-0@lo:400: 00000100:00100000:1.0:1787781833.235947:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962939008:12345-0@lo:400: Request processed in 26us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.235952:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787781833.236120:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787781833.236157:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd9a40 x1874624962939136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.236169:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787781833.236189:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962939136:0@lo:400: 00010000:00080000:1.0:1787781833.236203:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd92c0 x1874624962939008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.236212:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962939008:0@lo:400: 00010000:00080000:1.0:1787781833.236250:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fda940 x1874624962938496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.236260:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962938496:0@lo:400: 00010000:00080000:1.0:1787781833.237049:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd8b40 x1874624962938112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.237075:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962938112:0@lo:400: 00000100:00100000:0.0:1787781833.237129:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962938112:12345-0@lo:400: Request processed in 2185us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.237137:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787781833.237173:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962937856:0@lo:400: 00000100:00100000:0.0:1787781833.237213:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.237276:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962938368:0@lo:400: 00000100:00100000:0.0:1787781833.237300:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.237493:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962938880:0@lo:400: 00000100:00100000:0.0:1787781833.237521:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.237604:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937856 00000100:00100000:1.0:1787781833.237627:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937856 00000100:00100000:1.0:1787781833.237662:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938368 00000100:00100000:1.0:1787781833.237664:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938368 00000100:00100000:1.0:1787781833.237688:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787781833.237695:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962937856:12345-0@lo:400: 00000100:00100000:1.0:1787781833.237745:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962937856:12345-0@lo:400: Request processed in 50us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.237751:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787781833.237839:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781833.237847:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962938368:12345-0@lo:400: 00000100:00100000:1.0:1787781833.237874:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962938368:12345-0@lo:400: Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.237879:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787781833.237897:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781833.238131:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962939392:0@lo:41: 00000100:00100000:0.0:1787781833.238161:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787781833.238199:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0ea580 x1874624962937856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.238213:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962937856:0@lo:400: 00010000:00080000:0.0:1787781833.238224:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fda1c0 x1874624962938368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.238233:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962938368:0@lo:400: 00000100:00100000:0.0:1787781833.238251:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787781833.238258:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962937728:0@lo:400: 00000100:00100000:0.0:1787781833.238286:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.238308:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962938240:0@lo:400: 00000100:00100000:0.0:1787781833.238342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.238362:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962938752:0@lo:400: 00000100:00100000:0.0:1787781833.238385:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.238413:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962939264:0@lo:400: 00000100:00100000:0.0:1787781833.238443:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.239894:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938880 00000100:00100000:1.0:1787781833.239911:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938880 00000100:00100000:0.0:1787781833.240050:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939392 00000100:00100000:0.0:1787781833.240056:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939392 00000100:00100000:0.0:1787781833.240091:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938240 00000100:00100000:0.0:1787781833.240094:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938240 00000100:00100000:0.0:1787781833.240113:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781833.240123:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962939392:12345-0@lo:41: 00000004:00000024:0.0:1787781833.240167:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787781833.240257:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962939392:12345-0@lo:41: Request processed in 135us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.240264:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781833.240281:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781833.240287:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962938240:12345-0@lo:400: 00000100:00100000:1.0:1787781833.240396:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781833.240404:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962938880:12345-0@lo:400: 00000100:00100000:1.0:1787781833.240474:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962938880:12345-0@lo:400: Request processed in 71us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.240480:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781833.240503:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962937728 00000100:00100000:1.0:1787781833.240507:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962937728 00000100:00100000:1.0:1787781833.240532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787781833.240627:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962937728:12345-0@lo:400: 00000100:00100000:1.0:1787781833.240673:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962937728:12345-0@lo:400: Request processed in 135us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.240680:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1787781833.240717:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781833.240781:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962938240:12345-0@lo:400: Request processed in 494us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.240788:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781833.240821:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962938752 00000100:00100000:0.0:1787781833.240825:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962938752 00000100:00100000:0.0:1787781833.240867:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939264 00000100:00100000:0.0:1787781833.240871:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939264 00000100:00100000:0.0:1787781833.240891:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781833.240897:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962938752:12345-0@lo:400: 00000100:00100000:0.0:1787781833.240934:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962938752:12345-0@lo:400: Request processed in 38us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.240940:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781833.240951:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781833.240957:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962939264:12345-0@lo:400: 00000100:00080000:1.0:1787781833.241045:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781833.241048:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781833.241100:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962939264:12345-0@lo:400: Request processed in 143us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.241106:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781833.242843:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962937728:0@lo:400: 00000100:00100000:0.0:1787781833.242866:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962938240:0@lo:400: 00010000:00080000:0.0:1787781833.242883:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd8000 x1874624962938752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.242896:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962938752:0@lo:400: 00010000:00080000:0.0:1787781833.242910:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd8780 x1874624962939264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.242919:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787781833.242936:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962939264:0@lo:400: 00010000:00080000:0.0:1787781833.242950:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fdb480 x1874624962938880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.242958:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962938880:0@lo:400: 00000100:00100000:0.0:1787781833.242980:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962939392:0@lo:41: 00000100:00100000:3.0:1787781833.734887:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781833.735667:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962939648:0@lo:13: 00000100:00100000:3.0:1787781833.735760:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781833.735845:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962939520:0@lo:13: 00000100:00100000:3.0:1787781833.735875:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.736031:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939648 00000100:00100000:0.0:1787781833.736042:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939648 00000100:00100000:0.0:1787781833.736085:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939520 00000100:00100000:0.0:1787781833.736089:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939520 00000100:00100000:0.0:1787781833.736106:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781833.736115:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962939648:12345-0@lo:13: 00002000:00000024:0.0:1787781833.736149:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781833.736212:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962939648:12345-0@lo:13: Request processed in 97us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.736237:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781833.736277:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781833.736284:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962939520:12345-0@lo:13: 00002000:00000024:0.0:1787781833.736294:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781833.736321:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962939520:12345-0@lo:13: Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.736326:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787781833.736820:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4f00 x1874624962939648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.736845:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962939648:0@lo:13: 00010000:00080000:3.0:1787781833.736859:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fdb480 x1874624962939520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.736872:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962939520:0@lo:13: 00010000:00010000:1.0:1787781833.801086:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787781833.896142:0:10097:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781833.896155:0:10097:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787781834.250295:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962939776:0@lo:13: 00000100:00100000:1.0:1787781834.250401:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781834.250631:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939776 00000100:00100000:0.0:1787781834.250641:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939776 00000100:00100000:0.0:1787781834.250714:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781834.250726:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962939776:12345-0@lo:13: 00002000:00000024:0.0:1787781834.250763:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781834.250841:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962939776:12345-0@lo:13: Request processed in 117us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781834.250849:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787781834.250956:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a5a40 x1874624962939776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781834.250979:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962939776:0@lo:13: 00000100:00100000:3.0:1787781834.251057:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962939904:0@lo:13: 00000100:00100000:3.0:1787781834.251095:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781834.251148:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962939904 00000100:00100000:1.0:1787781834.251153:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962939904 00000100:00100000:1.0:1787781834.251177:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787781834.251185:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962939904:12345-0@lo:13: 00002000:00000024:1.0:1787781834.251198:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781834.251238:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962939904:12345-0@lo:13: Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.251245:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787781834.251516:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd8780 x1874624962939904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781834.251531:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962939904:0@lo:13: 00000100:00100000:1.0:1787781834.391500:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781834.391653:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942964864 00000100:00100000:3.0:1787781834.391666:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942964864 00000100:00100000:3.0:1787781834.391724:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00100000:3.0:1787781834.391735:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2405:x1874624942964864:12345-192.168.206.16@tcp:250: 00010000:00080000:3.0:1787781834.391771:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e9949f27-7277-4132-a8a2-0bcf34a2f9bc@192.168.206.16@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1787781834.391820:0:6525:0:(genops.c:1385:class_connect()) connect: client e9949f27-7277-4132-a8a2-0bcf34a2f9bc, cookie 0xc6d6745c150632f5 00000100:00080000:3.0:1787781834.391979:0:6525:0:(import.c:65:import_set_state_nolock()) ffff993c426a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781834.392082:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+5:2405:x1874624942964864:12345-192.168.206.16@tcp:250: Request processed in 346us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.392091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00100000:1.0:1787781834.409970:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781834.410171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942964992 00000100:00100000:2.0:1787781834.410184:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942964992 00000100:00100000:2.0:1787781834.410258:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 182 00000100:00100000:2.0:1787781834.410285:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+5:6178:x1874624942964992:12345-192.168.206.16@tcp:101: 00010000:00010000:2.0:1787781834.410308:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781834.410331:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83835 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781834.410367:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781834.410380:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781834.410391:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480600, rc 0) 00000100:00100000:2.0:1787781834.410586:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+6:6178:x1874624942964992:12345-192.168.206.16@tcp:101: Request processed in 303us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781834.410595:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 182 00000100:00100000:1.0:1787781834.413163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781834.413281:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965120 00000100:00100000:2.0:1787781834.413293:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965120 00000100:00100000:2.0:1787781834.413427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 183 00000100:00100000:2.0:1787781834.413439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+6:6178:x1874624942965120:12345-192.168.206.16@tcp:501: 00000100:00100000:2.0:1787781834.413890:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+6:6178:x1874624942965120:12345-192.168.206.16@tcp:501: Request processed in 451us (739us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781834.413901:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 183 00000100:00100000:1.0:1787781834.426372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781834.426510:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965248 00000100:00100000:3.0:1787781834.426524:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965248 00000100:00100000:3.0:1787781834.426593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 184 00000100:00100000:3.0:1787781834.426736:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+6:6178:x1874624942965248:12345-192.168.206.16@tcp:101: 00010000:00010000:3.0:1787781834.426761:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781834.426786:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8383c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.426833:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.426868:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.426879:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704600, rc 0) 00000100:00100000:3.0:1787781834.426947:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+7:6178:x1874624942965248:12345-192.168.206.16@tcp:101: Request processed in 344us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.427025:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 184 00000100:00100000:2.0:1787781834.431574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.431827:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965376 00000100:00100000:1.0:1787781834.431840:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965376 00000100:00100000:1.0:1787781834.431948:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 185 00000100:00100000:1.0:1787781834.431972:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+7:6178:x1874624942965376:12345-192.168.206.16@tcp:501: 00000100:00100000:1.0:1787781834.432221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6178:x1874624942965376:12345-192.168.206.16@tcp:501: Request processed in 251us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.432248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 185 00000100:00100000:0.0:1787781834.435021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781834.435174:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965504 00000100:00100000:2.0:1787781834.435186:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965504 00000100:00100000:2.0:1787781834.435251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 186 00000100:00100000:2.0:1787781834.435261:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6178:x1874624942965504:12345-192.168.206.16@tcp:503: 00000100:00100000:2.0:1787781834.435730:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6178:x1874624942965504:12345-192.168.206.16@tcp:503: Request processed in 468us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781834.435738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 186 00000100:00100000:2.0:1787781834.439255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.439858:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965632 00000100:00100000:1.0:1787781834.439871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965632 00000100:00100000:1.0:1787781834.439938:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 187 00000100:00100000:1.0:1787781834.439948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6196:x1874624942965632:12345-192.168.206.16@tcp:502: 00000100:00100000:1.0:1787781834.440443:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6196:x1874624942965632:12345-192.168.206.16@tcp:502: Request processed in 492us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.440452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 187 00000100:00100000:0.0:1787781834.476778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.479960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965760 00000100:00100000:1.0:1787781834.479982:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965760 00000100:00100000:1.0:1787781834.480217:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:1.0:1787781834.480231:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6196:x1874624942965760:12345-192.168.206.16@tcp:502: 00000100:00100000:1.0:1787781834.480453:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6196:x1874624942965760:12345-192.168.206.16@tcp:502: Request processed in 224us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.480461:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:0.0:1787781834.485736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.486086:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942965888 00000100:00100000:1.0:1787781834.486099:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942965888 00000100:00100000:1.0:1787781834.486251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00100000:1.0:1787781834.486263:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6178:x1874624942965888:12345-192.168.206.16@tcp:101: 00010000:00010000:1.0:1787781834.486283:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781834.486305:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039a00/0xc6d6745c1506330a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8386d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781834.486345:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039a00/0xc6d6745c1506330a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8386d expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781834.486463:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039a00/0xc6d6745c1506330a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8386d expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781834.486473:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039a00, rc 0) 00000100:00100000:1.0:1787781834.486551:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6178:x1874624942965888:12345-192.168.206.16@tcp:101: Request processed in 290us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.486559:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00100000:2.0:1787781834.490981:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.491236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966016 00000100:00100000:1.0:1787781834.491255:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966016 00000100:00100000:1.0:1787781834.491328:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:1.0:1787781834.491340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6178:x1874624942966016:12345-192.168.206.16@tcp:256: 20000000:01000000:1.0:1787781834.491465:0:6523:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787781834.491495:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787781834.491500:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787781834.491502:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787781834.491505:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787781834.491508:0:6523:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787781834.494568:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6178:x1874624942966016:12345-192.168.206.16@tcp:256: Request processed in 3214us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.494585:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:0.0:1787781834.498459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781834.498720:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966144 00000100:00100000:3.0:1787781834.498732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966144 00000100:00100000:3.0:1787781834.498825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00100000:3.0:1787781834.498837:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6178:x1874624942966144:12345-192.168.206.16@tcp:101: 00010000:00010000:3.0:1787781834.498858:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781834.498882:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83874 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.498917:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.498931:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781834.498942:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781834.499022:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6178:x1874624942966144:12345-192.168.206.16@tcp:101: Request processed in 187us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.499029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00100000:2.0:1787781834.504638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.504864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966272 00000100:00100000:1.0:1787781834.504878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966272 00000100:00100000:1.0:1787781834.505072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 192 00000100:00100000:1.0:1787781834.505086:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6178:x1874624942966272:12345-192.168.206.16@tcp:501: 00000100:00100000:1.0:1787781834.505308:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6178:x1874624942966272:12345-192.168.206.16@tcp:501: Request processed in 225us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.505336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 192 00000100:00100000:0.0:1787781834.508636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.508901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966400 00000100:00100000:1.0:1787781834.508915:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966400 00000100:00100000:1.0:1787781834.508990:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 193 00000100:00100000:1.0:1787781834.509001:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6178:x1874624942966400:12345-192.168.206.16@tcp:503: 00000100:00100000:1.0:1787781834.509187:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6178:x1874624942966400:12345-192.168.206.16@tcp:503: Request processed in 188us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.509196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 193 00000100:00100000:0.0:1787781834.512749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781834.513448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966528 00000100:00100000:1.0:1787781834.513462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966528 00000100:00100000:1.0:1787781834.513532:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 194 00000100:00100000:1.0:1787781834.513544:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6201:x1874624942966528:12345-192.168.206.16@tcp:502: 00000100:00100000:1.0:1787781834.513909:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6201:x1874624942966528:12345-192.168.206.16@tcp:502: Request processed in 365us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781834.513919:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 194 00000100:00100000:0.0:1787781834.517748:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781834.517998:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966656 00000100:00100000:3.0:1787781834.518011:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966656 00000100:00100000:3.0:1787781834.518095:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 195 00000100:00100000:3.0:1787781834.518107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6201:x1874624942966656:12345-192.168.206.16@tcp:502: 00000100:00100000:3.0:1787781834.518425:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6201:x1874624942966656:12345-192.168.206.16@tcp:502: Request processed in 320us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.518434:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 195 00000100:00100000:0.0:1787781834.523905:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781834.523968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781834.524226:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966784 00000100:00100000:2.0:1787781834.524239:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966784 00000100:00100000:2.0:1787781834.524294:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967040 00000100:00100000:2.0:1787781834.524298:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967040 00000100:00100000:2.0:1787781834.524324:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:2.0:1787781834.524334:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1874624942966784:12345-192.168.206.16@tcp:38: 00010000:00080000:2.0:1787781834.524386:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1787781834.524457:0:6532:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c15063318 00000004:00100000:2.0:1787781834.524487:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787781834.524971:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:3.0:1787781834.524980:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1874624942967040:12345-192.168.206.16@tcp:38: 00010000:00080000:3.0:1787781834.525001:0:10060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1787781834.525045:0:10060:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c1506331f 00000004:00100000:3.0:1787781834.525061:0:10060:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787781834.525478:0:10060:0:(import.c:65:import_set_state_nolock()) ffff993c431b7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781834.525569:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942967040:12345-192.168.206.16@tcp:38: Request processed in 587us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.525578:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00080000:2.0:1787781834.525891:0:6532:0:(import.c:65:import_set_state_nolock()) ffff993c43468000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787781834.525919:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942966784:12345-192.168.206.16@tcp:38: Request processed in 1586us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781834.525926:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00010000:00010000:1.0:1787781834.822682:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781835.539772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781835.539849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781835.539946:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967296 00000100:00100000:1.0:1787781835.539958:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967296 00000100:00100000:1.0:1787781835.540051:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942966912 00000100:00100000:1.0:1787781835.540054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942966912 00000100:00100000:1.0:1787781835.540082:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:1.0:1787781835.540094:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:6178:x1874624942967296:12345-192.168.206.16@tcp:41: 00000004:00000024:1.0:1787781835.540141:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787781835.540216:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:6178:x1874624942967296:12345-192.168.206.16@tcp:41: Request processed in 124us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781835.540224:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:1.0:1787781835.540252:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:1.0:1787781835.540258:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942966912:12345-192.168.206.16@tcp:41: 00000004:00000024:1.0:1787781835.540270:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787781835.540295:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942966912:12345-192.168.206.16@tcp:41: Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781835.540301:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00080000:2.0:1787781835.541097:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781835.541184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781835.541721:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967168 00000100:00100000:1.0:1787781835.541732:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967168 00000100:00100000:1.0:1787781835.541935:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:1.0:1787781835.541946:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942967168:12345-192.168.206.16@tcp:41: 00000004:00000024:1.0:1787781835.541985:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781835.542058:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942967168:12345-192.168.206.16@tcp:41: Request processed in 114us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781835.542065:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00080000:2.0:1787781835.546469:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781835.553155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781835.553385:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967424 00000100:00100000:2.0:1787781835.553398:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967424 00000100:00100000:2.0:1787781835.553477:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:2.0:1787781835.553489:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942967424:12345-192.168.206.16@tcp:40: 00000100:00100000:2.0:1787781835.554095:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942967424:12345-192.168.206.16@tcp:40: Request processed in 119us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781835.554119:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:3.0:1787781835.560547:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781835.560600:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781835.560733:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967552 00000100:00100000:0.0:1787781835.560754:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967552 00000100:00100000:0.0:1787781835.560815:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:0.0:1787781835.560824:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1874624942967552:12345-192.168.206.16@tcp:8: 00010000:00080000:0.0:1787781835.560868:0:8638:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1787781835.560905:0:8638:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c15063326 00002000:00100000:0.0:1787781835.560920:0:8638:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd0eda9e-1cb2-4b8a-8952-0f785606e4c5/ffff993c43222000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781835.560933:0:8638:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781835.561253:0:8638:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787781835.561288:0:8638:0:(import.c:65:import_set_state_nolock()) ffff993c43226000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787781835.561466:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967808 00000100:00100000:2.0:1787781835.561471:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967808 00000100:00100000:2.0:1787781835.561509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 196 00000100:00100000:2.0:1787781835.561516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942967808:12345-192.168.206.16@tcp:400: 00000100:00100000:0.0:1787781835.561676:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942967552:12345-192.168.206.16@tcp:8: Request processed in 850us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781835.561685:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:2.0:1787781835.565151:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942967808:12345-192.168.206.16@tcp:400: Request processed in 3616us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781835.565171:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 196 00000100:00100000:0.0:1787781835.568456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781835.568568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781835.568704:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967936 00000100:00100000:0.0:1787781835.568716:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967936 00000100:00100000:3.0:1787781835.568856:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942967680 00000100:00100000:3.0:1787781835.568861:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942967680 00000100:00100000:3.0:1787781835.568905:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:3.0:1787781835.568916:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1874624942967680:12345-192.168.206.16@tcp:8: 00010000:00080000:3.0:1787781835.568955:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:3.0:1787781835.569001:0:8446:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c1506332d 00002000:00100000:3.0:1787781835.569015:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd0eda9e-1cb2-4b8a-8952-0f785606e4c5/ffff993c431b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787781835.569038:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787781835.569257:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787781835.569295:0:8446:0:(import.c:65:import_set_state_nolock()) ffff993c431b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781835.569376:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942967680:12345-192.168.206.16@tcp:8: Request processed in 461us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781835.569385:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:0.0:1787781835.569862:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787781835.569877:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942967936:12345-192.168.206.16@tcp:900: 00000100:00100000:0.0:1787781835.569929:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942967936:12345-192.168.206.16@tcp:900: Request processed in 58us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781835.569937:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787781835.575422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781835.575553:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968064 00000100:00100000:1.0:1787781835.575565:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968064 00000100:00100000:1.0:1787781835.575697:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:1.0:1787781835.575710:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942968064:12345-192.168.206.16@tcp:33: 00000004:00080000:1.0:1787781835.602708:0:6534:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26868us 00000004:00200000:2.0:1787781835.633860:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787781835.634121:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6178:x1874624942968064:12345-192.168.206.16@tcp:33: Request processed in 58406us (58704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781835.634141:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00010000:00010000:1.0:1787781835.846061:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781835.856021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781835.856150:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968192 00000100:00100000:0.0:1787781835.856163:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968192 00000100:00100000:0.0:1787781835.856236:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787781835.856248:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6220:x1874624942968192:12345-192.168.206.16@tcp:101: 00010000:00010000:0.0:1787781835.856285:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781835.857152:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15063334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838a5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857243:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857256:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857270:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781835.857319:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787781835.857323:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781835.857338:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857369:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15063334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838a5 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857389:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838a5 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781835.857397:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:0.0:1787781835.857400:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781835.857417:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8600, rc 0) 00000100:00100000:0.0:1787781835.857494:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:6220:x1874624942968192:12345-192.168.206.16@tcp:101: Request processed in 1248us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781835.857502:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787781836.295988:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781836.296021:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962940032:0@lo:41: 00000100:00100000:0.0:1787781836.296110:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781836.296541:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940032 00000100:00100000:1.0:1787781836.296557:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940032 00000100:00100000:1.0:1787781836.296658:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781836.296669:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962940032:12345-0@lo:41: 00000004:00000024:1.0:1787781836.296769:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781836.296938:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962940032:12345-0@lo:41: Request processed in 268us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781836.296950:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787781836.298510:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962940032:0@lo:41: 00010000:00010000:1.0:1787781836.870091:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781837.894350:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781837.970131:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781837.972327:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968320 00000100:00100000:3.0:1787781837.972345:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968320 00000100:00100000:3.0:1787781837.972511:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:3.0:1787781837.972524:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:6272:x1874624942968320:12345-192.168.206.16@tcp:41: 00000004:00000024:3.0:1787781837.972573:0:10060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1787781837.973472:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781837.973594:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:6272:x1874624942968320:12345-192.168.206.16@tcp:41: Request processed in 1067us (3469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781837.973634:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:2.0:1787781837.981319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781837.981504:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968448 00000100:00100000:1.0:1787781837.981517:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968448 00000100:00100000:1.0:1787781837.981684:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:1.0:1787781837.981697:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968448:12345-192.168.206.16@tcp:41: 00000004:00000024:1.0:1787781837.981745:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781837.981837:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968448:12345-192.168.206.16@tcp:41: Request processed in 143us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781837.981845:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00080000:2.0:1787781837.983065:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781837.987645:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781837.988085:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968576 00000100:00100000:2.0:1787781837.988099:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968576 00000100:00100000:2.0:1787781837.988233:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:2.0:1787781837.988245:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968576:12345-192.168.206.16@tcp:13: 00002000:00000024:2.0:1787781837.988286:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781837.988371:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968576:12345-192.168.206.16@tcp:13: Request processed in 129us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781837.988379:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00080000:1.0:1787781837.988677:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781837.990438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781837.995640:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968704 00000100:00100000:0.0:1787781837.995662:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968704 00000100:00100000:0.0:1787781837.995787:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00080000:1.0:1787781837.995799:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781837.995803:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968704:12345-192.168.206.16@tcp:13: 00002000:00000024:0.0:1787781837.995849:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781837.996149:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:6272:x1874624942968704:12345-192.168.206.16@tcp:13: Request processed in 349us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781837.996158:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787781838.342467:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962940288:0@lo:400: 00000100:00100000:2.0:1787781838.342561:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.342671:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962940800:0@lo:400: 00000100:00100000:2.0:1787781838.342716:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.342744:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962941312:0@lo:400: 00000100:00100000:2.0:1787781838.342791:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.342822:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787781838.342827:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962940416:0@lo:400: 00000100:00100000:2.0:1787781838.342854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.342871:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962940928:0@lo:400: 00000100:00100000:2.0:1787781838.342906:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781838.343129:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962940160:0@lo:400: 00000100:00100000:0.0:1787781838.343170:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781838.343193:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962940672:0@lo:400: 00000100:00100000:0.0:1787781838.343219:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781838.343233:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962941184:0@lo:400: 00000100:00100000:0.0:1787781838.343255:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781838.343275:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962941696:0@lo:400: 00000100:00100000:0.0:1787781838.343298:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781838.343315:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787781838.343321:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962940544:0@lo:400: 00000100:00100000:0.0:1787781838.343354:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940288 00000100:00100000:0.0:1787781838.343369:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940288 00000100:00100000:0.0:1787781838.343417:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940800 00000100:00100000:0.0:1787781838.343420:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940800 00000100:00100000:0.0:1787781838.343443:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941312 00000100:00100000:0.0:1787781838.343445:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941312 00000100:00100000:0.0:1787781838.343463:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781838.343471:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962940288:12345-0@lo:400: 00000100:00080000:1.0:1787781838.343473:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781838.343487:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940416 00000100:00100000:1.0:1787781838.343491:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940416 00000100:00100000:1.0:1787781838.343517:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940672 00000100:00100000:1.0:1787781838.343519:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940672 00000100:00100000:0.0:1787781838.343525:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962940288:12345-0@lo:400: Request processed in 55us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781838.343533:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787781838.343534:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787781838.343540:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962940416:12345-0@lo:400: 00000100:00100000:0.0:1787781838.343549:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781838.343554:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962940800:12345-0@lo:400: 00000100:00100000:1.0:1787781838.343578:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962940416:12345-0@lo:400: Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781838.343578:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962940800:12345-0@lo:400: Request processed in 23us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.343584:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787781838.343597:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787781838.343602:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962940672:12345-0@lo:400: 00000100:00100000:0.0:1787781838.343668:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787781838.343684:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781838.343691:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962941312:12345-0@lo:400: 00000100:00100000:0.0:1787781838.343721:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962941312:12345-0@lo:400: Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781838.343727:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781838.343750:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941184 00000100:00100000:0.0:1787781838.343753:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941184 00000100:00100000:0.0:1787781838.343790:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941696 00000100:00100000:0.0:1787781838.343794:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941696 00000100:00100000:0.0:1787781838.343814:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787781838.343820:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962941184:12345-0@lo:400: 00000100:00100000:1.0:1787781838.343842:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962940672:12345-0@lo:400: Request processed in 239us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781838.343848:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962941184:12345-0@lo:400: Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.343849:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787781838.343863:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781838.343863:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787781838.343866:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781838.343873:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781838.343879:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962941696:12345-0@lo:400: 00000100:00100000:1.0:1787781838.343880:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940160 00000100:00100000:1.0:1787781838.343883:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940160 00000100:00100000:1.0:1787781838.343905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787781838.343911:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962940160:12345-0@lo:400: 00000100:00100000:0.0:1787781838.343926:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962941696:12345-0@lo:400: Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.343939:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962940160:12345-0@lo:400: Request processed in 28us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.343945:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787781838.344106:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940928 00000100:00100000:1.0:1787781838.344110:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940928 00000100:00100000:2.0:1787781838.344121:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962941440:0@lo:400: 00000100:00100000:1.0:1787781838.344134:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781838.344139:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962940928:12345-0@lo:400: 00000100:00100000:2.0:1787781838.344149:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781838.344165:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962940928:12345-0@lo:400: Request processed in 26us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.344170:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781838.344179:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941440 00000100:00100000:1.0:1787781838.344182:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941440 00000100:00100000:2.0:1787781838.344185:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962940288:0@lo:400: 00000100:00100000:1.0:1787781838.344196:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787781838.344199:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962940800:0@lo:400: 00000100:00100000:1.0:1787781838.344200:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962941440:12345-0@lo:400: 00000100:00100000:2.0:1787781838.344211:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962941312:0@lo:400: 00000100:00100000:1.0:1787781838.344223:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962941440:12345-0@lo:400: Request processed in 23us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.344228:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787781838.344237:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962940416:0@lo:400: 00000100:00080000:1.0:1787781838.344240:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787781838.344251:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4b40 x1874624962940928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781838.344262:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962940928:0@lo:400: 00000100:00100000:1.0:1787781838.344265:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787781838.344271:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4000 x1874624962941440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781838.344279:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962941440:0@lo:400: 00000100:00100000:1.0:1787781838.344282:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962941056:0@lo:400: 00000100:00100000:2.0:1787781838.344302:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962940544 00000100:00100000:2.0:1787781838.344305:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962940544 00000100:00100000:1.0:1787781838.344305:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781838.344319:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962941568:0@lo:400: 00000100:00100000:2.0:1787781838.344327:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787781838.344332:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962940544:12345-0@lo:400: 00000100:00100000:1.0:1787781838.344339:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781838.344354:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962940160:0@lo:400: 00000100:00100000:2.0:1787781838.344359:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962940544:12345-0@lo:400: Request processed in 27us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.344365:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962940672:0@lo:400: 00000100:00100000:2.0:1787781838.344372:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787781838.344374:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a43c0 x1874624962941184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781838.344382:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962941184:0@lo:400: 00010000:00080000:1.0:1787781838.344392:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bf2ed00 x1874624962941696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781838.344400:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962941696:0@lo:400: 00000100:00100000:1.0:1787781838.344424:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962940544:0@lo:400: 00000100:00100000:1.0:1787781838.344449:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941056 00000100:00100000:1.0:1787781838.344452:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941056 00000100:00100000:1.0:1787781838.344483:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941568 00000100:00100000:1.0:1787781838.344485:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941568 00000100:00100000:1.0:1787781838.344498:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781838.344503:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962941056:12345-0@lo:400: 00000100:00100000:3.0:1787781838.344508:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781838.344517:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962941824:0@lo:41: 00000100:00100000:1.0:1787781838.344537:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962941056:12345-0@lo:400: Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.344544:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781838.344555:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787781838.344558:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781838.344560:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962941568:12345-0@lo:400: 00000100:00100000:1.0:1787781838.344592:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962941568:12345-0@lo:400: Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781838.344598:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787781838.344642:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a52c0 x1874624962941056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781838.344644:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941824 00000100:00100000:3.0:1787781838.344648:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941824 00000100:00100000:1.0:1787781838.344651:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962941056:0@lo:400: 00010000:00080000:1.0:1787781838.344659:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bf2c780 x1874624962941568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781838.344667:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962941568:0@lo:400: 00000100:00100000:3.0:1787781838.344674:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787781838.344680:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962941824:12345-0@lo:41: 00000004:00000024:3.0:1787781838.344701:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787781838.344739:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962941824:12345-0@lo:41: Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781838.344752:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787781838.344795:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962941824:0@lo:41: 00000100:00100000:0.0:1787781838.345030:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787781838.345507:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781838.345512:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781838.854007:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781838.854047:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962941952:0@lo:13: 00000100:00100000:2.0:1787781838.854135:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.854234:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962941952 00000100:00100000:2.0:1787781838.854242:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962941952 00000100:00100000:2.0:1787781838.854299:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787781838.854309:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962941952:12345-0@lo:13: 00002000:00000024:2.0:1787781838.854350:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781838.854404:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962941952:12345-0@lo:13: Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781838.854412:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787781838.854463:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b61c0 x1874624962941952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781838.854485:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962941952:0@lo:13: 00000100:00100000:0.0:1787781838.854777:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962942080:0@lo:13: 00000100:00100000:0.0:1787781838.854816:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781838.855048:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942080 00000100:00100000:2.0:1787781838.855054:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942080 00000100:00100000:2.0:1787781838.855093:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787781838.855101:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962942080:12345-0@lo:13: 00002000:00000024:2.0:1787781838.855117:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781838.855161:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962942080:12345-0@lo:13: Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781838.855168:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787781838.855243:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd6d00 x1874624962942080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781838.855259:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962942080:0@lo:13: 00010000:00010000:0.0:1787781838.921758:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781839.365839:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962942208:0@lo:13: 00000100:00100000:1.0:1787781839.365914:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781839.365980:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942208 00000100:00100000:1.0:1787781839.365987:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942208 00000100:00100000:1.0:1787781839.366030:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787781839.366039:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962942208:12345-0@lo:13: 00002000:00000024:1.0:1787781839.366059:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781839.366100:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962942208:12345-0@lo:13: Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781839.366107:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787781839.366142:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427561c0 x1874624962942208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781839.366157:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962942208:0@lo:13: 00000100:00100000:1.0:1787781839.366452:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781839.366461:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962942336:0@lo:13: 00000100:00100000:1.0:1787781839.366487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781839.366655:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942336 00000100:00100000:1.0:1787781839.366672:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942336 00000100:00100000:1.0:1787781839.366697:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787781839.366704:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962942336:12345-0@lo:13: 00002000:00000024:1.0:1787781839.366715:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781839.366744:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962942336:12345-0@lo:13: Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781839.366750:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787781839.366787:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427561c0 x1874624962942336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781839.366799:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962942336:0@lo:13: 00000001:00100000:0.0:1787781839.889905:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000001:00100000:0.0:1787781839.890425:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000001:00100000:2.0:1787781839.891557:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00010000:00010000:1.0:1787781839.943778:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781840.787533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781840.787580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781840.787641:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968832 00000100:00100000:3.0:1787781840.787649:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781840.787651:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969088 00000100:00100000:1.0:1787781840.787658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968832 00000100:00100000:0.0:1787781840.787658:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969088 00000100:00100000:3.0:1787781840.787679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781840.787719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781840.787746:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969344 00000100:00100000:0.0:1787781840.787747:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942968960 00000100:00100000:3.0:1787781840.787750:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969344 00000100:00100000:0.0:1787781840.787753:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942968960 00000100:00100000:3.0:1787781840.787797:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969216 00000100:00100000:3.0:1787781840.787801:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969216 00000100:00100000:0.0:1787781840.787808:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:0.0:1787781840.787821:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942969088:12345-192.168.206.16@tcp:400: 00000100:00100000:3.0:1787781840.787836:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:3.0:1787781840.787847:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942969344:12345-192.168.206.16@tcp:400: 00000100:00100000:1.0:1787781840.787873:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00100000:1.0:1787781840.787884:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942968832:12345-192.168.206.16@tcp:400: 00000100:00100000:0.0:1787781840.787900:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942969088:12345-192.168.206.16@tcp:400: Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781840.787901:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942969344:12345-192.168.206.16@tcp:400: Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781840.787922:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787781840.787922:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942968832:12345-192.168.206.16@tcp:400: Request processed in 37us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781840.787923:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:1.0:1787781840.787936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00100000:3.0:1787781840.787951:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787781840.787954:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:3.0:1787781840.787964:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942969216:12345-192.168.206.16@tcp:400: 00000100:00100000:0.0:1787781840.787969:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942968960:12345-192.168.206.16@tcp:400: 00000100:00100000:3.0:1787781840.787998:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942969216:12345-192.168.206.16@tcp:400: Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00080000:1.0:1787781840.788000:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781840.788008:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00080000:1.0:1787781840.788008:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781840.788013:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781840.788016:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781840.788022:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942968960:12345-192.168.206.16@tcp:400: Request processed in 56us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781840.788031:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 58 00000001:02000400:2.0:1787781840.862982:0:10195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787781840.904799:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00010000:00010000:1.0:1787781840.965920:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781841.413844:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781841.413866:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962942464:0@lo:41: 00000100:00100000:2.0:1787781841.413947:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781841.414428:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942464 00000100:00100000:0.0:1787781841.414435:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942464 00000100:00100000:0.0:1787781841.414476:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787781841.414483:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962942464:12345-0@lo:41: 00000004:00000024:0.0:1787781841.414512:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781841.414573:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962942464:12345-0@lo:41: Request processed in 91us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.414580:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787781841.414664:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962942464:0@lo:41: 00010000:00010000:1.0:1787781841.995054:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781843.022045:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781843.464974:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962942720:0@lo:400: 00000100:00100000:1.0:1787781843.465076:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465138:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962943232:0@lo:400: 00000100:00100000:1.0:1787781843.465163:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465189:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962943744:0@lo:400: 00000100:00100000:1.0:1787781843.465209:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465245:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787781843.465250:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962942592:0@lo:400: 00000100:00100000:1.0:1787781843.465278:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465298:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962943104:0@lo:400: 00000100:00100000:1.0:1787781843.465319:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465334:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962943616:0@lo:400: 00000100:00100000:1.0:1787781843.465353:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465367:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962944128:0@lo:400: 00000100:00100000:1.0:1787781843.465383:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465406:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962942848:0@lo:400: 00000100:00100000:1.0:1787781843.465449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465464:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962943360:0@lo:400: 00000100:00100000:1.0:1787781843.465481:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465494:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962943872:0@lo:400: 00000100:00100000:1.0:1787781843.465515:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465526:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787781843.465530:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962942976:0@lo:400: 00000100:00100000:1.0:1787781843.465546:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465554:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962943488:0@lo:400: 00000100:00100000:1.0:1787781843.465585:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465601:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962944000:0@lo:400: 00000100:00100000:1.0:1787781843.465647:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.465679:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942720 00000100:00100000:1.0:1787781843.465687:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942720 00000100:00100000:1.0:1787781843.465726:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943232 00000100:00100000:1.0:1787781843.465728:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943232 00000100:00100000:1.0:1787781843.465764:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943744 00000100:00100000:1.0:1787781843.465767:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943744 00000100:00100000:1.0:1787781843.465779:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943360 00000100:00100000:1.0:1787781843.465781:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943360 00000100:00100000:1.0:1787781843.465806:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943872 00000100:00100000:1.0:1787781843.465808:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943872 00000100:00100000:1.0:1787781843.465818:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942976 00000100:00100000:1.0:1787781843.465819:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942976 00000100:00100000:1.0:1787781843.465839:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787781843.465847:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962942720:12345-0@lo:400: 00000100:00100000:1.0:1787781843.465900:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962942720:12345-0@lo:400: Request processed in 53us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781843.465906:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787781843.465924:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787781843.465929:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962943232:12345-0@lo:400: 00000100:00100000:1.0:1787781843.465952:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962943232:12345-0@lo:400: Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466015:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781843.466024:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962943744:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466058:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962943744:12345-0@lo:400: Request processed in 36us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466063:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781843.466080:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781843.466085:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962943360:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466129:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962943360:12345-0@lo:400: Request processed in 43us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466135:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781843.466146:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787781843.466151:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962943872:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466174:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962943872:12345-0@lo:400: Request processed in 24us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466179:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787781843.466197:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781843.466202:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962942976:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466229:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962942976:12345-0@lo:400: Request processed in 27us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466234:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781843.466252:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943104 00000100:00100000:0.0:1787781843.466255:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943104 00000100:00100000:0.0:1787781843.466278:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942848 00000100:00100000:0.0:1787781843.466281:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942848 00000100:00100000:0.0:1787781843.466292:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787781843.466297:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962943104:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466326:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962943104:12345-0@lo:400: Request processed in 29us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466331:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787781843.466343:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781843.466348:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962942848:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466372:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962942848:12345-0@lo:400: Request processed in 24us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466377:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781843.466414:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962942976:0@lo:400: 00000100:00100000:0.0:1787781843.466423:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962942848:0@lo:400: 00010000:00080000:0.0:1787781843.466436:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d44f00 x1874624962943360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.466447:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962943360:0@lo:400: 00010000:00080000:0.0:1787781843.466456:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6a1c0 x1874624962943872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.466475:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962943872:0@lo:400: 00000100:00100000:0.0:1787781843.466536:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943616 00000100:00100000:0.0:1787781843.466540:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943616 00000100:00100000:0.0:1787781843.466561:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944128 00000100:00100000:0.0:1787781843.466564:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944128 00000100:00100000:0.0:1787781843.466576:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962943488 00000100:00100000:0.0:1787781843.466579:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962943488 00000100:00100000:0.0:1787781843.466590:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944000 00000100:00100000:0.0:1787781843.466593:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944000 00000100:00100000:0.0:1787781843.466625:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781843.466631:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962943616:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466665:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962943616:12345-0@lo:400: Request processed in 33us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466671:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781843.466683:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781843.466688:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962944128:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466714:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962944128:12345-0@lo:400: Request processed in 27us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466719:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781843.466729:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781843.466735:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962943488:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466782:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962943488:12345-0@lo:400: Request processed in 48us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466788:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781843.466799:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781843.466805:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962944000:12345-0@lo:400: 00000100:00100000:0.0:1787781843.466841:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962944000:12345-0@lo:400: Request processed in 37us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781843.466847:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787781843.466885:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d461c0 x1874624962943488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.466894:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962943488:0@lo:400: 00010000:00080000:0.0:1787781843.466902:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6a940 x1874624962944000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.466909:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962944000:0@lo:400: 00000100:00080000:0.0:1787781843.466952:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781843.466957:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781843.466960:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781843.466962:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781843.466986:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962943104:0@lo:400: 00010000:00080000:0.0:1787781843.466998:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fe12c0 x1874624962943616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.467006:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962943616:0@lo:400: 00010000:00080000:0.0:1787781843.467016:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c683c0 x1874624962944128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.467024:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962944128:0@lo:400: 00000100:00100000:0.0:1787781843.467034:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962942720:0@lo:400: 00000100:00100000:0.0:1787781843.467045:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962943232:0@lo:400: 00000100:00100000:0.0:1787781843.467056:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962943744:0@lo:400: 00000100:00100000:1.0:1787781843.467165:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787781843.467288:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962942592 00000100:00100000:3.0:1787781843.467293:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962942592 00000100:00100000:3.0:1787781843.467326:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787781843.467333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962942592:12345-0@lo:400: 00000100:00100000:3.0:1787781843.467385:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962942592:12345-0@lo:400: Request processed in 53us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781843.467392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787781843.470458:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962942592:0@lo:400: 00000100:00100000:1.0:1787781843.470652:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781843.470669:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962944256:0@lo:41: 00000100:00100000:1.0:1787781843.470757:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.470806:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944256 00000100:00100000:1.0:1787781843.470823:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944256 00000100:00100000:1.0:1787781843.470874:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787781843.470884:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962944256:12345-0@lo:41: 00000004:00000024:1.0:1787781843.470924:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787781843.470971:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962944256:12345-0@lo:41: Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781843.470978:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787781843.471017:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962944256:0@lo:41: 00000100:00100000:1.0:1787781843.973978:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781843.974005:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962944384:0@lo:13: 00000100:00100000:1.0:1787781843.974088:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781843.974321:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944384 00000100:00100000:3.0:1787781843.974330:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944384 00000100:00100000:3.0:1787781843.974384:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787781843.974393:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962944384:12345-0@lo:13: 00002000:00000024:3.0:1787781843.974419:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781843.974474:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962944384:12345-0@lo:13: Request processed in 82us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781843.974481:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787781843.974561:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd6940 x1874624962944384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.974580:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962944384:0@lo:13: 00000100:00100000:0.0:1787781843.974913:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962944512:0@lo:13: 00000100:00100000:0.0:1787781843.974944:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781843.975008:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944512 00000100:00100000:1.0:1787781843.975012:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944512 00000100:00100000:1.0:1787781843.975044:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781843.975059:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962944512:12345-0@lo:13: 00002000:00000024:1.0:1787781843.975071:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781843.975300:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962944512:12345-0@lo:13: Request processed in 248us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781843.975308:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787781843.975357:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f67c00 x1874624962944512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781843.975372:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962944512:0@lo:13: 00010000:00010000:1.0:1787781844.037855:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781844.486296:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962944640:0@lo:13: 00000100:00100000:0.0:1787781844.486399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781844.486494:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944640 00000100:00100000:0.0:1787781844.486502:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944640 00000100:00100000:0.0:1787781844.486560:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781844.486572:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962944640:12345-0@lo:13: 00002000:00000024:0.0:1787781844.486633:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781844.486685:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962944640:12345-0@lo:13: Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781844.486692:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787781844.486748:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd43c0 x1874624962944640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781844.486770:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962944640:0@lo:13: 00000100:00100000:0.0:1787781844.493091:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962944768:0@lo:13: 00000100:00100000:0.0:1787781844.493188:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781844.500634:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962944768 00000100:00100000:1.0:1787781844.500654:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962944768 00000100:00100000:1.0:1787781844.501490:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781844.501510:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962944768:12345-0@lo:13: 00002000:00000024:1.0:1787781844.501547:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781844.501692:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962944768:12345-0@lo:13: Request processed in 189us (8504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781844.501718:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787781844.505843:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b7480 x1874624962944768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781844.505878:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962944768:0@lo:13: 00000020:00000080:2.0:1787781845.037925:0:10342:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc70ed1640 20000000:00000080:2.0:1787781845.037946:0:10342:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993c436d8800 uarg=0000000000000000 20000000:01000000:2.0:1787781845.038010:0:10342:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787781845.038013:0:10342:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787781845.038016:0:10342:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787781845.038022:0:10342:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787781845.038027:0:10342:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787781845.038095:0:10342:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787781845.038098:0:10342:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787781845.039263:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787781845.040281:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787781845.040395:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787781845.040414:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787781845.040427:0:10342:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787781845.040430:0:10342:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787781845.047937:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787781845.048521:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787781845.048559:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787781845.048575:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787781845.048586:0:10342:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787781845.048589:0:10342:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787781845.057058:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787781845.057636:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787781845.057684:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787781845.057704:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787781845.057714:0:10342:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787781845.057717:0:10342:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787781845.062132:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00010000:00010000:1.0:1787781845.062357:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781845.062545:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787781845.062581:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787781845.062653:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787781845.062666:0:10342:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787781845.062669:0:10342:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787781845.064548:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1787781845.065753:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1787781845.065793:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1787781845.065810:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:0.0:1787781845.065829:0:10342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787781845.065855:0:10342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065878:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065886:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063200 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065894:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506323f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065901:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506324d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065908:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506325b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065916:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063277 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065922:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065947:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632bd expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065955:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065967:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065975:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.065984:0:10342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.066036:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.066566:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781845.066585:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962944896:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781845.079465:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079487:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 9 pid: 6523 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079507:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c683c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945024:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781845.079552:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079562:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079573:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945152:0@lo:104: 00000100:00100000:1.0:1787781845.079641:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.079710:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079719:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 23 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079728:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945280:0@lo:104: 00000100:00100000:1.0:1787781845.079764:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.079795:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079816:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079825:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945408:0@lo:104: 00000100:00100000:1.0:1787781845.079863:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.079881:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079890:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 23 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079899:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945536:0@lo:104: 00000100:00100000:1.0:1787781845.079921:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.079937:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079945:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079955:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945664:0@lo:104: 00010000:00010000:1.0:1787781845.079980:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.079989:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 23 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.079997:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945792:0@lo:104: 00010000:00010000:1.0:1787781845.080021:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.080036:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.081649:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945920:0@lo:104: 00000100:00100000:2.0:1787781845.081671:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787781845.081710:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.081742:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.081758:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.081770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945152 00000100:00100000:2.0:1787781845.081778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945152 00010000:00010000:1.0:1787781845.081782:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.081796:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 23 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.081807:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962946048:0@lo:104: 00000100:00100000:2.0:1787781845.081821:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945280 00000100:00100000:2.0:1787781845.081825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945280 00000100:00100000:1.0:1787781845.081828:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.081837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945408 00000100:00100000:2.0:1787781845.081840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945408 00000100:00100000:2.0:1787781845.081850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945536 00000100:00100000:2.0:1787781845.081853:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945536 00000100:00100000:2.0:1787781845.081863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945920 00000100:00100000:2.0:1787781845.081865:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945920 00000100:00100000:2.0:1787781845.081872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945664 00000100:00100000:2.0:1787781845.081873:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945664 00000100:00100000:2.0:1787781845.081881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962945792 00000100:00100000:2.0:1787781845.081883:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962945792 00000100:00100000:2.0:1787781845.081890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946048 00000100:00100000:2.0:1787781845.081892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946048 00000100:00100000:2.0:1787781845.081909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781845.081918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:10342:x1874624962945152:12345-0@lo:104: 00010000:00010000:2.0:1787781845.081932:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.081992:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781845.081998:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+10:10342:x1874624962945152:12345-0@lo:104: Request processed in 83us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.082006:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787781845.082011:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.082019:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.082028:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962946176:0@lo:104: 00000100:00100000:2.0:1787781845.082041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787781845.082047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:10342:x1874624962945280:12345-0@lo:104: 00010000:00010000:2.0:1787781845.082056:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.082094:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787781845.082100:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+9:10342:x1874624962945280:12345-0@lo:104: Request processed in 53us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.082106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787781845.082119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787781845.082126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+8:10342:x1874624962945408:12345-0@lo:104: 00010000:00010000:2.0:1787781845.082134:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.082164:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787781845.082169:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+8:10342:x1874624962945408:12345-0@lo:104: Request processed in 45us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.082175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787781845.082186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787781845.082193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:10342:x1874624962945536:12345-0@lo:104: 00010000:00010000:2.0:1787781845.082201:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.082227:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781845.082229:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787781845.082233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:10342:x1874624962945536:12345-0@lo:104: Request processed in 42us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.082239:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781845.082240:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003180 going to sleep for 11 seconds 00000100:00100000:1.0:1787781845.082263:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945152:0@lo:104: 00000100:00100000:1.0:1787781845.082271:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945280:0@lo:104: 00000100:00100000:2.0:1787781845.082275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946176 00000100:00100000:2.0:1787781845.082277:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946176 00000100:00100000:1.0:1787781845.082278:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945408:0@lo:104: 00000100:00100000:1.0:1787781845.082285:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945536:0@lo:104: 00010000:00010000:1.0:1787781845.082342:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787781845.082356:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.082364:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038e00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781845.082369:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.082378:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781845.082511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781845.082520:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:10342:x1874624962945920:12345-0@lo:104: 00010000:00010000:2.0:1787781845.082529:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.082566:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787781845.082571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+7:10342:x1874624962945920:12345-0@lo:104: Request processed in 54us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.082577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781845.082589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787781845.082594:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:10342:x1874624962945664:12345-0@lo:104: 00010000:00010000:2.0:1787781845.082601:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.083213:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787781845.083220:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:10342:x1874624962945664:12345-0@lo:104: Request processed in 625us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.083228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787781845.083248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781845.083256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:10342:x1874624962945792:12345-0@lo:104: 00010000:00010000:2.0:1787781845.083265:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781845.083587:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781845.083594:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781845.083651:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083659:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781845.083680:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083688:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c150632e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632ee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083709:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787781845.083712:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083718:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039800 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781845.083721:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083756:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781845.083763:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781845.083768:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781845.083783:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083789:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781845.083795:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083801:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43039800/0xc6d6745c150632bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083812:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787781845.083815:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083821:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781845.083824:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.083830:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084378:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787781845.084441:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962946432:0@lo:103: 00010000:00010000:2.0:1787781845.084451:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787781845.084459:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:10342:x1874624962945792:12345-0@lo:104: Request processed in 1204us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.084478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787781845.084494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.084508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787781845.084518:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:10342:x1874624962946048:12345-0@lo:104: 00010000:00010000:2.0:1787781845.084530:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781845.084536:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781845.084541:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962946304:0@lo:103: 00000100:00100000:0.0:1787781845.084561:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781845.084565:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787781845.084570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:10342:x1874624962946048:12345-0@lo:104: Request processed in 56us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.084576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787781845.084590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787781845.084597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10342:x1874624962946176:12345-0@lo:104: 00000100:00100000:0.0:1787781845.084597:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946432 00000100:00100000:0.0:1787781845.084623:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946432 00010000:00010000:0.0:1787781845.084653:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 24 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781845.084676:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946304 00000100:00100000:0.0:1787781845.084679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946304 00010000:00010000:0.0:1787781845.084690:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 25 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781845.084709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781845.084716:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3658:x1874624962946432:12345-0@lo:103: 00010000:00010000:0.0:1787781845.084727:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781845.084742:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 25 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084752:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 25 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084771:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039400/0xc6d6745c150632c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150632bd expref: 25 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084785:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781845.084813:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962946432:12345-0@lo:103: Request processed in 99us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781845.084820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781845.084878:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781845.084884:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3658:x1874624962946304:12345-0@lo:103: 00010000:00010000:0.0:1787781845.084891:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781845.084895:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084910:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084920:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166200/0xc6d6745c150632ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150632e7 expref: 23 pid: 6523 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.084928:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781845.084950:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3658:x1874624962946304:12345-0@lo:103: Request processed in 66us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781845.084955:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781845.084992:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962946304:0@lo:103: 00000100:00100000:0.0:1787781845.085001:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962946432:0@lo:103: 10000000:00010000:1.0:1787781845.085955:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781845.085985:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781845.086025:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.086032:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787781845.086658:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962944896:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781845.086673:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c683c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945024:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781845.086686:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945664:0@lo:104: 00000100:00100000:0.0:1787781845.086695:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945792:0@lo:104: 00000100:00100000:0.0:1787781845.086706:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962945920:0@lo:104: 00000100:00100000:0.0:1787781845.086714:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962946048:0@lo:104: 00010000:00010000:2.0:1787781845.086797:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.086896:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787781845.086904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10342:x1874624962946176:12345-0@lo:104: Request processed in 2307us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.086915:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787781845.087782:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1874624962946176:0@lo:104: 00010000:00010000:0.0:1787781845.088017:0:10342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088084:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787781845.088097:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088105:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781845.088110:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088121:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781845.088127:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781845.088133:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781845.088180:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088204:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781845.088226:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088234:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038000/0xc6d6745c15063277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506327e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088249:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787781845.088253:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088259:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781845.088262:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088269:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781845.088276:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781845.088281:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781845.088295:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088302:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781845.088307:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088312:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c1506325b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088329:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787781845.088333:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088338:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781845.088341:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088347:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781845.088354:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781845.088359:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781845.088373:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088379:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787781845.088580:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962946560:0@lo:103: 00000100:00100000:0.0:1787781845.088671:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.088762:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.088771:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c150632a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150632a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.088782:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781845.088786:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.088791:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781845.088795:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.088802:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781845.088809:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781845.088814:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781845.088831:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088843:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088851:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9e00/0xc6d6745c1506324d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063254 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088861:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781845.088864:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088880:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41480200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781845.088883:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088890:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781845.088897:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781845.088902:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781845.088919:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088925:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781845.088930:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088935:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d41480200/0xc6d6745c150631d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631dd expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.088945:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781845.088947:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781845.088949:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781845.088962:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962946816:0@lo:103: 00000100:00100000:3.0:1787781845.088992:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781845.089024:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787781845.089030:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962946688:0@lo:103: 00000100:00100000:3.0:1787781845.089063:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781845.089080:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962947200:0@lo:103: 00000100:00100000:3.0:1787781845.089101:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781845.089118:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781845.089136:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946560 00010000:00010000:1.0:1787781845.089143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166000/0xc6d6745c15063200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063207 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946560 00010000:00010000:1.0:1787781845.089152:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781845.089153:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781845.089155:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781845.089173:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 22 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946816 00000100:00100000:3.0:1787781845.089196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946816 00000100:00100000:1.0:1787781845.089201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00010000:00010000:3.0:1787781845.089206:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946688 00000100:00100000:3.0:1787781845.089218:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946688 00010000:00010000:3.0:1787781845.089228:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 24 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947200 00000100:00100000:3.0:1787781845.089238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947200 00010000:00010000:3.0:1787781845.089247:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 25 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089255:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969600 00000100:00100000:3.0:1787781845.089256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969600 00010000:00010000:3.0:1787781845.089267:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 10 pid: 6523 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781845.089290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781845.089296:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3657:x1874624962946560:12345-0@lo:103: 00000100:00100000:1.0:1787781845.089307:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962947072:0@lo:103: 00010000:00010000:3.0:1787781845.089312:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781845.089324:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 25 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.089329:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781845.089335:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 25 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.089353:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039600/0xc6d6745c150632a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150632a1 expref: 25 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.089367:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781845.089370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969472 00000100:00100000:1.0:1787781845.089373:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969472 00000100:00100000:3.0:1787781845.089399:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962946560:12345-0@lo:103: Request processed in 103us (728us total) trans 0 rc 0/0 00010000:00010000:1.0:1787781845.089401:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 11 pid: 6525 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781845.089414:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947072 00000100:00100000:1.0:1787781845.089416:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947072 00000100:00100000:3.0:1787781845.089423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787781845.089428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962946816:12345-0@lo:103: 00010000:00010000:3.0:1787781845.089436:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781845.089440:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 24 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.089448:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 24 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.089458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8400/0xc6d6745c15063262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506325b expref: 24 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.089467:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781845.089495:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3660:x1874624962946816:12345-0@lo:103: Request processed in 66us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781845.089501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787781845.089503:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 23 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.089512:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787781845.089553:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962946560:0@lo:103: 00000100:00100000:0.0:1787781845.089568:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781845.089573:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962946944:0@lo:103: 00000100:00100000:0.0:1787781845.089596:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781845.089618:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962946944 00000100:00100000:2.0:1787781845.089623:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962946944 00010000:00010000:2.0:1787781845.089641:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 23 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.090757:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781845.090779:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3660:x1874624962947200:12345-0@lo:103: 00010000:00010000:1.0:1787781845.090797:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781845.090804:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.090817:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.090860:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82167200/0xc6d6745c150631dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150631d6 expref: 23 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.090876:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781845.090946:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3660:x1874624962947200:12345-0@lo:103: Request processed in 178us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.090954:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787781845.090971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962946688:12345-0@lo:103: 00010000:00010000:3.0:1787781845.090980:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781845.090985:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 21 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.090985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:1.0:1787781845.090991:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:2409:x1874624942969600:12345-192.168.206.16@tcp:103: 00010000:00010000:3.0:1787781845.090995:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 21 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091000:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781845.091004:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 11 pid: 6523 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.091005:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43038400/0xc6d6745c1506327e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063277 expref: 21 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091013:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 11 pid: 6523 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.091020:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781845.091024:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480600/0xc6d6745c150632fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83835 expref: 11 pid: 6523 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091033:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781845.091672:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2409:x1874624942969600:12345-192.168.206.16@tcp:103: Request processed in 675us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.091681:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:1.0:1787781845.091706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:1.0:1787781845.091716:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:2409:x1874624942969472:12345-192.168.206.16@tcp:103: 00010000:00010000:1.0:1787781845.091755:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781845.091766:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091781:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091794:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704600/0xc6d6745c15063303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8383c expref: 9 pid: 6525 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.091805:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781845.093128:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3660:x1874624962946688:12345-0@lo:103: Request processed in 3594us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781845.093143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787781845.093178:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781845.093195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624962947072:12345-0@lo:103: 00010000:00010000:3.0:1787781845.093214:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781845.093223:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 19 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.093238:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 19 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.093269:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8a00/0xc6d6745c15063207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063200 expref: 19 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.093283:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781845.093343:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:3660:x1874624962947072:12345-0@lo:103: Request processed in 156us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781845.093366:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787781845.093596:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781845.096312:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787781845.096341:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:3657:x1874624962946944:12345-0@lo:103: 00010000:00010000:2.0:1787781845.096369:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781845.096398:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 17 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.096417:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 17 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.096441:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8800/0xc6d6745c15063254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506324d expref: 17 pid: 6525 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781845.096466:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781845.096567:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3657:x1874624962946944:12345-0@lo:103: Request processed in 242us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.096576:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787781845.096770:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.096783:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781845.096788:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.096799:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781845.096806:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781845.096813:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781845.096852:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.096860:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781845.096879:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781845.096886:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c1506323f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063246 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781845.096916:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781845.096932:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962947328:0@lo:103: 00000100:00100000:3.0:1787781845.096982:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781845.097045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947328 00000100:00100000:3.0:1787781845.097054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947328 00010000:00010000:3.0:1787781845.097081:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.097194:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:2409:x1874624942969472:12345-192.168.206.16@tcp:103: Request processed in 5475us (7897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.097203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:1.0:1787781845.097256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787781845.097265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:3658:x1874624962947328:12345-0@lo:103: 00010000:00010000:1.0:1787781845.097276:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781845.097281:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097552:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097567:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506323f expref: 16 pid: 6526 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097582:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097591:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097655:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097662:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097669:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097675:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097682:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781845.097686:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097694:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097714:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781845.097725:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781845.097786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:3658:x1874624962947328:12345-0@lo:103: Request processed in 522us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.097794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787781845.097901:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962946688:0@lo:103: 00010000:00010000:0.0:1787781845.098082:0:10342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.098091:0:10342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781845.098098:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8200/0xc6d6745c15063342 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781845.106378:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962947328:0@lo:103: 00000100:00100000:1.0:1787781845.106599:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962947200:0@lo:103: 00000100:00100000:1.0:1787781845.106678:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962946816:0@lo:103: 00000100:00100000:1.0:1787781845.106721:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962947072:0@lo:103: 00000100:00100000:1.0:1787781845.106796:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962946944:0@lo:103: 00010000:00010000:2.0:1787781845.107456:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781845.107462:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781845.107474:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781845.107477:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781845.107479:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781845.895474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781845.895529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781845.895765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781845.895906:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969728 00000100:00100000:1.0:1787781845.895919:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969728 00000100:00100000:1.0:1787781845.895981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:1.0:1787781845.895991:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:2406:x1874624942969728:12345-192.168.206.16@tcp:400: 00000100:00100000:1.0:1787781845.896083:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:2406:x1874624942969728:12345-192.168.206.16@tcp:400: Request processed in 93us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.896092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:2.0:1787781845.896599:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970240 00000100:00100000:2.0:1787781845.896636:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970240 00000100:00100000:2.0:1787781845.896692:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:2.0:1787781845.896702:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942970240:12345-192.168.206.16@tcp:400: 00000100:00100000:2.0:1787781845.896762:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942970240:12345-192.168.206.16@tcp:400: Request processed in 61us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.896769:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00080000:1.0:1787781845.896945:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781845.897747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781845.901378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781845.901569:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970112 00000100:00100000:2.0:1787781845.901671:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970112 00000100:00100000:2.0:1787781845.901763:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:2.0:1787781845.901776:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942970112:12345-192.168.206.16@tcp:400: 00000100:00100000:2.0:1787781845.901949:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942970112:12345-192.168.206.16@tcp:400: Request processed in 176us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781845.901957:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787781845.902439:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969984 00000100:00100000:0.0:1787781845.902447:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969984 00000100:00100000:1.0:1787781845.902916:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942969856 00000100:00100000:1.0:1787781845.902923:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942969856 00000100:00100000:1.0:1787781845.902965:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:1.0:1787781845.902977:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942969984:12345-192.168.206.16@tcp:400: 00000100:00080000:3.0:1787781845.903234:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781845.903239:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781845.903242:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781845.903303:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942969984:12345-192.168.206.16@tcp:400: Request processed in 328us (7772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.903311:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:1.0:1787781845.903329:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:1.0:1787781845.903336:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942969856:12345-192.168.206.16@tcp:400: 00000100:00100000:1.0:1787781845.903364:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942969856:12345-192.168.206.16@tcp:400: Request processed in 29us (5634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781845.903371:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 66 00010000:00010000:3.0:1787781846.086005:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781846.534194:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781846.534227:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962947456:0@lo:41: 00000100:00100000:0.0:1787781846.534315:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.534762:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947456 00000100:00100000:3.0:1787781846.534774:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947456 00000100:00100000:3.0:1787781846.534842:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781846.534854:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962947456:12345-0@lo:41: 00000004:00000024:3.0:1787781846.535009:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781846.535127:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962947456:12345-0@lo:41: Request processed in 275us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.535136:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781846.543272:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962947456:0@lo:41: 10000000:01000000:1.0:1787781846.917760:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787781846.917771:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d7c44e000 from 48 10000000:01000000:1.0:1787781846.917778:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787781846.917858:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.917871:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.917883:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.917911:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947584:0@lo:101: 00000100:00100000:1.0:1787781846.918002:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.918084:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.918295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947584 00000100:00100000:2.0:1787781846.918305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947584 00000100:00100000:2.0:1787781846.918368:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787781846.918390:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+15:6528:x1874624962947584:12345-0@lo:101: 00010000:00010000:2.0:1787781846.918407:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781846.918424:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480200/0xc6d6745c15063350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063349 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.918454:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480200/0xc6d6745c15063350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063349 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.918466:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480200/0xc6d6745c15063350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063349 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.918475:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480200, rc 0) 00000100:00100000:2.0:1787781846.918538:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962947584:12345-0@lo:101: Request processed in 160us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.918545:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787781846.918789:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947584:0@lo:101: 00010000:00010000:3.0:1787781846.918806:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.918816:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781846.918916:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947712:0@lo:501: 00000100:00100000:3.0:1787781846.918958:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.918996:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.919059:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947712 00000100:00100000:0.0:1787781846.919064:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947712 00000100:00100000:0.0:1787781846.919101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787781846.919110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962947712:12345-0@lo:501: 00000100:00100000:0.0:1787781846.919254:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962947712:12345-0@lo:501: Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.919261:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787781846.919336:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947712:0@lo:501: 00000100:00100000:3.0:1787781846.919367:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947840:0@lo:503: 00000100:00100000:3.0:1787781846.919416:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.919436:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.919536:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947840 00000100:00100000:0.0:1787781846.919546:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947840 00000100:00100000:0.0:1787781846.919566:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787781846.919573:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962947840:12345-0@lo:503: 00000100:00100000:0.0:1787781846.919710:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962947840:12345-0@lo:503: Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.919717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787781846.919914:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962947840:0@lo:503: 00000100:00100000:3.0:1787781846.921329:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10361:1874624962947968:0@lo:502: 00000100:00100000:3.0:1787781846.921415:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.921465:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.921597:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962947968 00000100:00100000:0.0:1787781846.921630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962947968 00000100:00100000:0.0:1787781846.921683:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787781846.921692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:10361:x1874624962947968:12345-0@lo:502: 00000100:00100000:0.0:1787781846.921846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:10361:x1874624962947968:12345-0@lo:502: Request processed in 154us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.921854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787781846.922013:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10361:1874624962947968:0@lo:502: 00000100:00100000:3.0:1787781846.922066:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10361:1874624962948096:0@lo:502: 00000100:00100000:3.0:1787781846.922101:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.922225:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.925995:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948096 00000100:00100000:2.0:1787781846.926014:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948096 00000100:00100000:2.0:1787781846.926104:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787781846.926116:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:10361:x1874624962948096:12345-0@lo:502: 00000100:00100000:2.0:1787781846.926578:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:10361:x1874624962948096:12345-0@lo:502: Request processed in 464us (4476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.926587:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787781846.928441:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10361:1874624962948096:0@lo:502: 00000040:00080000:3.0:1787781846.928503:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787781846.928831:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787781846.928864:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787781846.928877:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.928889:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781846.928900:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787781846.928903:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787781846.928911:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787781846.928958:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.928966:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.928976:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.929014:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948224:0@lo:101: 00000100:00100000:1.0:1787781846.929082:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.929131:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.929198:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948224 00000100:00100000:0.0:1787781846.929205:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948224 00000100:00100000:0.0:1787781846.929259:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787781846.929269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+16:6528:x1874624962948224:12345-0@lo:101: 00010000:00010000:0.0:1787781846.929292:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781846.929308:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8200/0xc6d6745c1506335e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063357 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.929335:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8200/0xc6d6745c1506335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063357 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.929346:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8200/0xc6d6745c1506335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063357 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.929356:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8200, rc 0) 00000100:00100000:0.0:1787781846.929414:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948224:12345-0@lo:101: Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.929428:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787781846.929643:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948224:0@lo:101: 00010000:00010000:1.0:1787781846.929659:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.929669:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.929744:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948352:0@lo:501: 00000100:00100000:1.0:1787781846.929774:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.929798:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.929893:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948352 00000100:00100000:3.0:1787781846.929899:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948352 00000100:00100000:3.0:1787781846.929934:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787781846.929943:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948352:12345-0@lo:501: 00000100:00100000:3.0:1787781846.930084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948352:12345-0@lo:501: Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.930092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787781846.930164:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948352:0@lo:501: 00000100:00100000:1.0:1787781846.930193:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948480:0@lo:503: 00000100:00100000:1.0:1787781846.930234:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.930264:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.930420:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948480 00000100:00100000:2.0:1787781846.930426:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948480 00000100:00100000:2.0:1787781846.930451:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787781846.930458:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948480:12345-0@lo:503: 00000100:00100000:2.0:1787781846.930557:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948480:12345-0@lo:503: Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.930564:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787781846.930740:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948480:0@lo:503: 00000100:00100000:0.0:1787781846.931204:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10362:1874624962948608:0@lo:502: 00000100:00100000:0.0:1787781846.931253:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.931356:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.931470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948608 00000100:00100000:2.0:1787781846.931476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948608 00000100:00100000:2.0:1787781846.931523:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787781846.931531:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:10362:x1874624962948608:12345-0@lo:502: 00000100:00100000:2.0:1787781846.931867:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:10362:x1874624962948608:12345-0@lo:502: Request processed in 335us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.931874:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787781846.938124:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10362:1874624962948608:0@lo:502: 00000020:01000000:1.0:1787781846.938224:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781846.938245:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781846.938247:0:10362:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787781846.938256:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787781846.938497:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10362:1874624962948736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.938598:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.938907:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.942899:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948736 00000100:00100000:3.0:1787781846.942938:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948736 00000100:00100000:3.0:1787781846.943009:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787781846.943019:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:10362:x1874624962948736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.943240:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:10362:x1874624962948736:12345-0@lo:502:llog_process_th.0 Request processed in 222us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.943248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787781846.943740:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10362:1874624962948736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781846.943788:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781846.943797:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781846.943799:0:10362:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787781846.943804:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787781846.944017:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787781846.944041:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787781846.944054:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.944072:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781846.944084:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781846.944088:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d7236f800 from 48 10000000:01000000:2.0:1787781846.944091:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781846.944133:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.944142:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.944163:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781846.944187:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.944242:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.944503:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.944969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948864 00000100:00100000:1.0:1787781846.944978:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948864 00000100:00100000:0.0:1787781846.945096:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787781846.945106:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+17:6528:x1874624962948864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781846.945122:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781846.945140:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9000/0xc6d6745c1506336c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063365 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.945169:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9000/0xc6d6745c1506336c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063365 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.945181:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9000/0xc6d6745c1506336c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063365 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.945191:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9000, rc 0) 00000100:00100000:0.0:1787781846.945252:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962948864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.945260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787781846.945375:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.945394:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.945403:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781846.945482:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.945512:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.945545:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.945599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962948992 00000100:00100000:0.0:1787781846.945669:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962948992 00000100:00100000:0.0:1787781846.945703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787781846.945710:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962948992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.945852:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962948992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.945859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787781846.945994:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962948992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.946028:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.946069:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.946134:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.946164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949120 00000100:00100000:3.0:1787781846.946169:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949120 00000100:00100000:3.0:1787781846.946203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787781846.946211:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962949120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.946310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962949120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.946318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787781846.946384:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.946778:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10363:1874624962949248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.946816:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.946879:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.946982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949248 00000100:00100000:2.0:1787781846.946987:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949248 00000100:00100000:2.0:1787781846.947023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787781846.947031:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:10363:x1874624962949248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.947137:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:10363:x1874624962949248:12345-0@lo:502:llog_process_th.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.947144:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787781846.947285:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10363:1874624962949248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.947327:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10363:1874624962949376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.947360:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.947381:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.947423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949376 00000100:00100000:3.0:1787781846.947427:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949376 00000100:00100000:3.0:1787781846.947446:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787781846.947452:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:10363:x1874624962949376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.947528:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:10363:x1874624962949376:12345-0@lo:502:llog_process_th.0 Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.947535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787781846.947598:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10363:1874624962949376:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787781846.947646:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787781846.947823:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787781846.947849:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787781846.947860:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.947877:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781846.947887:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787781846.947891:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787781846.947894:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787781846.947921:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.947929:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.947940:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781846.947954:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.947983:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.948015:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f41900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.948055:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949504 00000100:00100000:1.0:1787781846.948059:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949504 00000100:00100000:1.0:1787781846.948081:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787781846.948087:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+18:6528:x1874624962949504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781846.948106:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781846.948121:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039800/0xc6d6745c1506337a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063373 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.948145:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039800/0xc6d6745c1506337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063373 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.948156:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039800/0xc6d6745c1506337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063373 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.948165:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039800, rc 0) 00000100:00100000:1.0:1787781846.948205:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962949504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.948211:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787781846.948267:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781846.948279:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.948288:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781846.948335:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.948358:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.948387:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f41900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.948424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949632 00000100:00100000:1.0:1787781846.948429:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949632 00000100:00100000:1.0:1787781846.948447:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787781846.948453:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962949632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.948566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962949632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.948573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787781846.948680:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.948707:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.948754:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.948775:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f41900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.948828:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949760 00000100:00100000:1.0:1787781846.948832:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949760 00000100:00100000:1.0:1787781846.948851:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787781846.948856:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962949760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.948937:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962949760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.948953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787781846.949019:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962949760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.949474:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10364:1874624962949888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.949514:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.949537:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.949579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962949888 00000100:00100000:1.0:1787781846.949583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962949888 00000100:00100000:1.0:1787781846.949639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787781846.949647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:10364:x1874624962949888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.949747:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:10364:x1874624962949888:12345-0@lo:502:llog_process_th.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.949753:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787781846.949839:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10364:1874624962949888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781846.949865:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781846.949875:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781846.949877:0:10364:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787781846.949883:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787781846.949904:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10364:1874624962950016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.949937:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.949967:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ad7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.950020:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950016 00000100:00100000:2.0:1787781846.950025:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950016 00000100:00100000:2.0:1787781846.950047:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787781846.950062:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:10364:x1874624962950016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.950143:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:10364:x1874624962950016:12345-0@lo:502:llog_process_th.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.950149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787781846.950249:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10364:1874624962950016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781846.950266:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781846.950271:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781846.950272:0:10364:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787781846.950276:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787781846.950430:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787781846.950465:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787781846.950476:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.950488:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781846.950498:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787781846.950500:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d80a11800 from 48 10000000:01000000:1.0:1787781846.950504:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787781846.950532:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.950540:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.950551:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.950564:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.950601:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.950649:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.950698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950144 00000100:00100000:2.0:1787781846.950703:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950144 00000100:00100000:2.0:1787781846.950740:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787781846.950748:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:6528:x1874624962950144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.950757:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781846.950771:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480e00/0xc6d6745c15063388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063381 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.950793:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480e00/0xc6d6745c15063388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063381 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.950804:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480e00/0xc6d6745c15063388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063381 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.950812:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480e00, rc 0) 00000100:00100000:2.0:1787781846.950848:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.950854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787781846.950941:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781846.950956:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781846.950977:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781846.951028:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.951054:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.951073:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.951113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950272 00000100:00100000:1.0:1787781846.951117:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950272 00000100:00100000:1.0:1787781846.951136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787781846.951142:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.951259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.951266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787781846.951366:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.951391:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.951425:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.951444:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.951519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950400 00000100:00100000:0.0:1787781846.951524:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950400 00000100:00100000:0.0:1787781846.951556:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787781846.951563:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.951661:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.951667:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787781846.951893:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.952329:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10365:1874624962950528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.952372:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.952438:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.952471:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950528 00000100:00100000:0.0:1787781846.952475:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950528 00000100:00100000:0.0:1787781846.952542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787781846.952551:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:10365:x1874624962950528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781846.953046:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:10365:x1874624962950528:12345-0@lo:502:llog_process_th.0 Request processed in 494us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.953055:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787781846.953267:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10365:1874624962950528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.953332:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10365:1874624962950656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.953370:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.953405:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.953465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950656 00000100:00100000:2.0:1787781846.953470:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950656 00000100:00100000:2.0:1787781846.953509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787781846.953517:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:10365:x1874624962950656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.953632:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:10365:x1874624962950656:12345-0@lo:502:llog_process_th.0 Request processed in 115us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.953645:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787781846.953744:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10365:1874624962950656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787781846.953764:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787781846.953926:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787781846.953950:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781846.953960:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.953970:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781846.953980:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787781846.953983:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787781846.953986:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787781846.954014:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.954021:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.954038:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781846.954054:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.954083:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.954115:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003600 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.954169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950784 00000100:00100000:2.0:1787781846.954174:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950784 00000100:00100000:2.0:1787781846.954206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787781846.954213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962950784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.954222:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781846.954237:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d41480c00/0xc6d6745c15063396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506338f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.954261:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d41480c00/0xc6d6745c15063396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506338f expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.954271:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d41480c00/0xc6d6745c15063396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506338f expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.954279:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d41480c00, rc 0) 00000100:00100000:2.0:1787781846.954433:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962950784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.954439:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787781846.954574:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781846.954588:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.954598:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781846.954846:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.954875:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.954903:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.954977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962950912 00000100:00100000:1.0:1787781846.954982:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962950912 00000100:00100000:1.0:1787781846.955017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787781846.955025:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962950912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.955153:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962950912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.955159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787781846.955246:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962950912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.955275:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.955314:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.955337:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003600 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.955376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951040 00000100:00100000:3.0:1787781846.955380:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951040 00000100:00100000:3.0:1787781846.955412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787781846.955428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962951040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.955517:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962951040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.955524:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787781846.955640:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.956257:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10366:1874624962951168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781846.956302:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.956370:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781846.957123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951168 00000100:00100000:3.0:1787781846.957132:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951168 00000100:00100000:3.0:1787781846.957232:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787781846.957243:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10366:x1874624962951168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.957403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10366:x1874624962951168:12345-0@lo:502:llog_process_th.0 Request processed in 161us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.957410:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787781846.957495:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10366:1874624962951168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781846.957532:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781846.957544:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781846.957547:0:10366:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787781846.957554:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787781846.957587:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10366:1874624962951296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781846.957655:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.958381:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.958472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951296 00000100:00100000:2.0:1787781846.958480:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951296 00000100:00100000:2.0:1787781846.958524:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787781846.958533:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10366:x1874624962951296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.958701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10366:x1874624962951296:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.958709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787781846.958836:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10366:1874624962951296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781846.958871:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781846.958879:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781846.958882:0:10366:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787781846.958886:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787781846.959142:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787781846.959175:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787781846.959188:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.959199:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781846.959210:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781846.959213:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d47267800 from 48 10000000:01000000:2.0:1787781846.959216:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781846.959251:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.959260:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.959270:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781846.959291:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.959330:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.959367:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.959450:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951424 00000100:00100000:0.0:1787781846.959456:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951424 00000100:00100000:0.0:1787781846.959481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787781846.959488:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962951424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781846.959499:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781846.959514:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8e00/0xc6d6745c150633a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506339d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.959539:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8e00/0xc6d6745c150633a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506339d expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.959550:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8e00/0xc6d6745c150633a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506339d expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.959560:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8e00, rc 0) 00000100:00100000:0.0:1787781846.959601:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962951424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.959646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787781846.959737:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.959751:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.959761:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781846.959906:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.959939:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.959960:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.959997:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951552 00000100:00100000:0.0:1787781846.960001:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951552 00000100:00100000:0.0:1787781846.960019:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787781846.960025:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962951552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.960185:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962951552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.960192:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787781846.960343:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.960375:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.960414:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.960474:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.960501:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951680 00000100:00100000:1.0:1787781846.960506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951680 00000100:00100000:0.0:1787781846.960552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787781846.960560:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962951680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.960805:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962951680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.960960:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962951680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.961379:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10367:1874624962951808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.961421:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.961475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787781846.961521:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.961804:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951808 00000100:00100000:0.0:1787781846.961824:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951808 00000100:00100000:0.0:1787781846.961850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787781846.961857:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10367:x1874624962951808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781846.962008:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10367:x1874624962951808:12345-0@lo:502:llog_process_th.0 Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.962016:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787781846.962172:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10367:1874624962951808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.962223:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10367:1874624962951936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781846.962258:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781846.962288:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.962338:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962951936 00000100:00100000:0.0:1787781846.962343:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962951936 00000100:00100000:0.0:1787781846.962362:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787781846.962368:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10367:x1874624962951936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781846.962446:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10367:x1874624962951936:12345-0@lo:502:llog_process_th.0 Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.962459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787781846.962558:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10367:1874624962951936:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787781846.962578:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787781846.962888:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787781846.962913:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781846.962925:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.962937:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781846.962948:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787781846.962951:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787781846.962954:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787781846.962984:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.962993:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.963004:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781846.965183:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.965276:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.965371:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.965417:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952064 00000100:00100000:2.0:1787781846.965425:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952064 00000100:00100000:2.0:1787781846.965520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787781846.965531:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962952064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.965551:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781846.965573:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150f800/0xc6d6745c150633b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150633ab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.965665:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150f800/0xc6d6745c150633b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150633ab expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.965678:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150f800/0xc6d6745c150633b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633ab expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.965688:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150f800, rc 0) 00000100:00100000:2.0:1787781846.965748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.965756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787781846.965960:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781846.965979:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781846.966002:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781846.966096:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.966125:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781846.967531:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.967582:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952192 00000100:00100000:1.0:1787781846.967591:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952192 00000100:00100000:1.0:1787781846.969101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787781846.969129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.969414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781846.969451:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.969495:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787781846.969646:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.969805:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.969848:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781846.969894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952320 00000100:00100000:0.0:1787781846.969902:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952320 00000100:00100000:0.0:1787781846.969937:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787781846.969944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781846.970063:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781846.970070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787781846.970191:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781846.971431:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10368:1874624962952448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.971508:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.971668:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d497030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.971784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952448 00000100:00100000:1.0:1787781846.971791:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952448 00000100:00100000:1.0:1787781846.971846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787781846.971855:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10368:x1874624962952448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.971999:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10368:x1874624962952448:12345-0@lo:502:llog_process_th.0 Request processed in 145us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.972006:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787781846.972118:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10368:1874624962952448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781846.972150:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781846.972161:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781846.972163:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787781846.972169:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787781846.972200:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10368:1874624962952576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781846.972236:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781846.972259:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d497030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781846.972751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952576 00000100:00100000:1.0:1787781846.972757:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952576 00000100:00100000:1.0:1787781846.972786:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787781846.972793:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10368:x1874624962952576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781846.972892:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10368:x1874624962952576:12345-0@lo:502:llog_process_th.0 Request processed in 98us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781846.972898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787781846.973091:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10368:1874624962952576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781846.973118:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781846.973123:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781846.973125:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787781846.973129:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787781846.973313:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787781846.973340:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787781846.973351:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.973363:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781846.973374:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787781846.973377:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993d588099b8 from 1 10000000:01000000:1.0:1787781846.973380:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781846.973409:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.973417:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.973439:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.973458:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.973494:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.973568:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.973637:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952704 00000100:00100000:2.0:1787781846.973642:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952704 00000100:00100000:2.0:1787781846.973670:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787781846.973677:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962952704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781846.973688:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781846.973702:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150ec00/0xc6d6745c150633c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150633b9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.973738:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150ec00/0xc6d6745c150633c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150633b9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.973749:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150ec00/0xc6d6745c150633c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633b9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781846.973758:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150ec00, rc 0) 00000100:00100000:2.0:1787781846.973798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962952704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781846.973805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787781846.973942:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781846.973957:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.973966:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781846.974025:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781846.974053:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781846.974075:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41cb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781846.974113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952832 00000100:00100000:2.0:1787781846.974118:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952832 00000100:00100000:2.0:1787781846.974136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787781846.974142:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962952832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781846.974228:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962952832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (174us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781846.974236:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787781846.974294:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962952832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787781846.974317:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787781846.974324:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781846.974332:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781847.109880:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781848.133915:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781848.582185:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962952960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781848.582281:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781848.582347:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962952960 00000100:00100000:1.0:1787781848.582371:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962952960 00000100:00100000:1.0:1787781848.582449:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787781848.582462:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962952960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781848.582502:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787781848.582577:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962952960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781848.582586:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787781848.582667:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962952960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781848.583028:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962953088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.583081:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781848.583225:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962953344:0@lo:400:kworker.0 00000100:00100000:1.0:1787781848.583264:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781848.583299:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781848.583305:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962953216:0@lo:400:kworker.0 00000100:00100000:1.0:1787781848.583327:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781848.583354:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953344 00000100:00100000:1.0:1787781848.583358:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953344 00000100:00100000:1.0:1787781848.583386:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953216 00000100:00100000:1.0:1787781848.583388:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953216 00000100:00100000:1.0:1787781848.583403:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787781848.583410:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962953344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.583535:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787781848.583557:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962953216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781848.583856:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962953344:12345-0@lo:400:kworker.0 Request processed in 444us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781848.583865:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787781848.585098:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781848.585121:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962953472:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.585324:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.585415:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953472 00000100:00100000:0.0:1787781848.585424:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953472 00000100:00100000:0.0:1787781848.585477:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781848.585487:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962953472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.585552:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962953472:12345-0@lo:400:kworker.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781848.585574:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787781848.585631:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962953472:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.585690:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953088 00000100:00100000:0.0:1787781848.585694:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953088 00000100:00100000:0.0:1787781848.585740:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787781848.585890:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962953088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.585936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962953088:12345-0@lo:400:kworker.0 Request processed in 190us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781848.585943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787781848.585983:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962953088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.586448:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962953600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.586490:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.586539:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953600 00000100:00100000:0.0:1787781848.586543:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953600 00000100:00100000:0.0:1787781848.586585:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787781848.586593:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.586648:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962953600:12345-0@lo:400:kworker.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781848.586656:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787781848.586683:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962953600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.586731:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962953728:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.587122:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.587168:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953728 00000100:00100000:0.0:1787781848.587172:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953728 00000100:00100000:2.0:1787781848.587178:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962953216:12345-0@lo:400:kworker.0 Request processed in 3610us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781848.587190:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787781848.587230:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781848.587235:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781848.587249:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787781848.587258:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962953728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.587308:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962953728:12345-0@lo:400:kworker.0 Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781848.587314:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787781848.587600:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962953984:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.587646:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.587734:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781848.587740:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962954112:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.587938:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.587967:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954112 00000100:00100000:0.0:1787781848.587971:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954112 00000100:00100000:0.0:1787781848.588071:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787781848.588077:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962954112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.588115:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962954112:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781848.588121:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787781848.588153:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962954112:0@lo:400:kworker.0 00000100:00100000:3.0:1787781848.588367:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781848.588379:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962954496:0@lo:400:kworker.0 00000100:00100000:3.0:1787781848.588429:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781848.588461:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953984 00000100:00100000:3.0:1787781848.588464:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953984 00000100:00100000:3.0:1787781848.588493:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954496 00000100:00100000:3.0:1787781848.588496:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954496 00000100:00100000:3.0:1787781848.588513:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787781848.588520:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962953984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781848.588551:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962953984:12345-0@lo:400:kworker.0 Request processed in 32us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781848.588556:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787781848.588567:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787781848.588572:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962954496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781848.588600:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962954496:12345-0@lo:400:kworker.0 Request processed in 28us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781848.588627:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787781848.588660:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1c780 x1874624962954496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781848.588683:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962954496:0@lo:400:kworker.0 00000100:00080000:2.0:1787781848.588793:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781848.588798:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781848.588800:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781848.588814:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962954240:0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.588852:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787781848.588888:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f66940 x1874624962953728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781848.588902:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962953728:0@lo:400:kworker.0 00010000:00080000:0.0:1787781848.588903:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f66580 x1874624962953984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781848.588916:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962953984:0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.588919:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787781848.588937:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962953856:0@lo:400:kworker.0 00000100:00100000:0.0:1787781848.588953:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954240 00000100:00100000:0.0:1787781848.588958:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954240 00000100:00100000:2.0:1787781848.588982:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781848.589020:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962954368:0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.589049:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781848.589067:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787781848.589077:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781848.589077:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962954240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.589102:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962953856 00000100:00100000:2.0:1787781848.589107:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962953856 00000100:00100000:0.0:1787781848.589135:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962954240:12345-0@lo:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781848.589143:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954368 00000100:00100000:0.0:1787781848.589144:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787781848.589148:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954368 00000100:00100000:2.0:1787781848.589190:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787781848.589198:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962953856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.589230:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962953856:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781848.589236:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787781848.589251:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781848.589257:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962954368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781848.589285:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962954368:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781848.589302:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787781848.589317:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781848.589320:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787781848.589342:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f65a40 x1874624962953856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781848.589354:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962953856:0@lo:400:kworker.0 00010000:00080000:2.0:1787781848.589367:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f652c0 x1874624962954368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781848.589375:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962954368:0@lo:400:kworker.0 00010000:00080000:2.0:1787781848.589393:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f643c0 x1874624962954240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781848.589401:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962954240:0@lo:400:kworker.0 00000100:00100000:1.0:1787781848.589835:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962953216:0@lo:400:kworker.0 00000100:00100000:1.0:1787781848.589851:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962953344:0@lo:400:kworker.0 00000100:00100000:2.0:1787781849.097570:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962954624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781849.097741:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781849.097804:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962954752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781849.097881:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781849.097919:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954624 00000100:00100000:2.0:1787781849.097930:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954624 00000100:00100000:2.0:1787781849.097979:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954752 00000100:00100000:2.0:1787781849.097992:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954752 00000100:00100000:2.0:1787781849.098017:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781849.098026:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962954624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787781849.098065:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781849.098128:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962954624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.098136:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781849.098154:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787781849.098159:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962954752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781849.098169:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781849.098208:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962954752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.098214:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787781849.098384:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cab0c0 x1874624962954624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781849.098405:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962954624:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787781849.098487:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962954752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781849.098516:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962954752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781849.158985:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781849.480504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781849.480640:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970368 00000100:00100000:1.0:1787781849.480651:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970368 00000100:00100000:1.0:1787781849.480734:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 244 00000100:00100000:1.0:1787781849.480744:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:6192:x1874624942970368:12345-192.168.206.16@tcp:101: 00010000:00010000:1.0:1787781849.480760:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781849.480784:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038000/0xc6d6745c150633c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838ac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781849.480815:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038000/0xc6d6745c150633c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ac expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781849.480828:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038000/0xc6d6745c150633c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ac expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781849.480837:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038000, rc 0) 00000100:00100000:1.0:1787781849.480911:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942970368:12345-192.168.206.16@tcp:101: Request processed in 168us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781849.480919:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 244 00000100:00100000:3.0:1787781849.502545:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781849.504901:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970496 00000100:00100000:0.0:1787781849.504915:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970496 00000100:00100000:0.0:1787781849.504986:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 245 00000100:00100000:0.0:1787781849.504996:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942970496:12345-192.168.206.16@tcp:501: 00000100:00100000:0.0:1787781849.505155:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942970496:12345-192.168.206.16@tcp:501: Request processed in 160us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781849.505163:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 245 00000100:00100000:3.0:1787781849.509155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781849.509273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970624 00000100:00100000:2.0:1787781849.509289:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970624 00000100:00100000:2.0:1787781849.509364:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 246 00000100:00100000:2.0:1787781849.509374:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942970624:12345-192.168.206.16@tcp:503: 00000100:00100000:2.0:1787781849.509536:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942970624:12345-192.168.206.16@tcp:503: Request processed in 163us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.509545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 246 00000100:00100000:3.0:1787781849.520752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781849.521110:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970752 00000100:00100000:1.0:1787781849.521124:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970752 00000100:00100000:1.0:1787781849.521210:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 247 00000100:00100000:1.0:1787781849.521220:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6690:x1874624942970752:12345-192.168.206.16@tcp:502: 00000100:00100000:1.0:1787781849.521386:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6690:x1874624942970752:12345-192.168.206.16@tcp:502: Request processed in 166us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781849.521394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 247 00000100:00100000:3.0:1787781849.525015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781849.530053:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942970880 00000100:00100000:0.0:1787781849.530331:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942970880 00000100:00100000:0.0:1787781849.530574:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:0.0:1787781849.530588:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6690:x1874624942970880:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781849.532662:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6690:x1874624942970880:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 2062us (7645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781849.532678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:3.0:1787781849.541340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781849.541844:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971008 00000100:00100000:2.0:1787781849.541859:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971008 00000100:00100000:2.0:1787781849.541930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:2.0:1787781849.541940:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942971008:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781849.541957:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781849.541975:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e000/0xc6d6745c150633ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838b3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781849.542004:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e000/0xc6d6745c150633ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838b3 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781849.542015:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e000/0xc6d6745c150633ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838b3 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781849.542024:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e000, rc 0) 00000100:00100000:2.0:1787781849.542092:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942971008:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 154us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.542100:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:3.0:1787781849.545133:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781849.545282:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971136 00000100:00100000:0.0:1787781849.545294:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971136 00000100:00100000:0.0:1787781849.545374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00100000:0.0:1787781849.545385:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942971136:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781849.547316:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942971136:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 1864us (2125us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781849.547333:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00100000:3.0:1787781849.606161:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781849.608008:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781849.608126:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781849.610191:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962954880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781849.610381:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955008 00000100:00100000:2.0:1787781849.610403:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955008 00000100:00100000:2.0:1787781849.610489:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787781849.610501:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962955008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781849.610545:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781849.617140:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962955008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6628us (9001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.617173:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787781849.617718:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b7480 x1874624962955008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781849.617748:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781849.619134:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781849.619279:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962954880 00000100:00100000:0.0:1787781849.619290:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962954880 00000100:00100000:0.0:1787781849.619351:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787781849.619361:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962954880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781849.619392:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781849.619487:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962954880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781849.619495:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787781849.619564:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fe12c0 x1874624962954880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781849.619585:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962954880:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787781850.183030:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781851.015752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781851.015786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781851.015825:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781851.015842:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781851.015863:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781851.015899:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971776 00000100:00100000:0.0:1787781851.015909:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971776 00000100:00100000:0.0:1787781851.015974:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971648 00000100:00100000:0.0:1787781851.015978:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971648 00000100:00100000:0.0:1787781851.016002:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:0.0:1787781851.016013:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971776:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781851.016114:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971776:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.016122:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:0.0:1787781851.016139:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:0.0:1787781851.016146:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971648:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781851.016172:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971648:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.016195:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:2.0:1787781851.016405:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971520 00000100:00100000:2.0:1787781851.016410:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971520 00000100:00100000:2.0:1787781851.016451:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971392 00000100:00100000:2.0:1787781851.016454:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971392 00000100:00100000:2.0:1787781851.016481:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:2.0:1787781851.016489:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971520:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781851.016524:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942971520:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 36us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.016531:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:2.0:1787781851.016547:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:2.0:1787781851.016553:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942971392:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781851.016576:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942971392:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 23us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.016582:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00080000:2.0:1787781851.016629:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781851.016633:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781851.016635:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781851.016637:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781851.016712:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971264 00000100:00100000:1.0:1787781851.016717:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971264 00000100:00100000:1.0:1787781851.016751:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 251 00000100:00100000:1.0:1787781851.016758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942971264:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781851.016783:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942971264:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781851.016789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 251 00010000:00010000:1.0:1787781851.207991:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787781851.440061:0:10406:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9ae82250 20000000:00000080:0.0:1787781851.440077:0:10406:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993d67f23000 uarg=0000000000000000 20000000:01000000:0.0:1787781851.440171:0:10406:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787781851.440176:0:10406:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787781851.440181:0:10406:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787781851.440928:0:10407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787781851.441020:0:10406:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787781851.448822:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787781851.448851:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787781851.448864:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787781851.448878:0:10406:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787781851.448899:0:10406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448922:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506306a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448930:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063078 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448937:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150630cc expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448957:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448965:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.448973:0:10406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449016:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449030:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 9 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.449044:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955136:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781851.449166:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449174:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 23 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.449183:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955264:0@lo:104: 00000100:00100000:1.0:1787781851.449222:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781851.449257:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449265:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 23 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.449281:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955392:0@lo:104: 00000100:00100000:1.0:1787781851.449306:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787781851.449340:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449349:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 23 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.449358:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955520:0@lo:104: 00010000:00010000:1.0:1787781851.449382:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.449390:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 23 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.449392:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787781851.449398:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955648:0@lo:104: 00000100:00100000:0.0:1787781851.449409:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781851.449817:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955264 00000100:00100000:2.0:1787781851.449825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955264 00000100:00100000:2.0:1787781851.449860:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955392 00000100:00100000:2.0:1787781851.449863:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955392 00000100:00100000:2.0:1787781851.449872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955520 00000100:00100000:2.0:1787781851.449874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955520 00000100:00100000:2.0:1787781851.449885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787781851.449893:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:10406:x1874624962955264:12345-0@lo:104: 00010000:00010000:2.0:1787781851.449912:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.455986:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781851.456001:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:10406:x1874624962955264:12345-0@lo:104: Request processed in 6105us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.456014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787781851.456048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787781851.456059:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c436da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:10406:x1874624962955392:12345-0@lo:104: 00010000:00010000:2.0:1787781851.456076:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.456124:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787781851.456130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c436da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:10406:x1874624962955392:12345-0@lo:104: Request processed in 75us (6824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.456136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787781851.456169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787781851.456176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10406:x1874624962955520:12345-0@lo:104: 00010000:00010000:2.0:1787781851.456184:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.456218:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787781851.456224:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10406:x1874624962955520:12345-0@lo:104: Request processed in 49us (6814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.456229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1787781851.456352:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781851.456359:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456367:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41481200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781851.456371:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456380:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.456408:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.456413:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781851.456453:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456460:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781851.456480:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456488:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d41481200/0xc6d6745c150630cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150630d3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456502:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781851.456505:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456510:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150e200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787781851.456513:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456520:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.456525:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.456531:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781851.456552:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456558:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781851.456572:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456578:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150e200/0xc6d6745c15063078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506307f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456588:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781851.456590:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781851.456591:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781851.456634:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962955776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781851.456675:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781851.456735:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962955904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781851.456761:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781851.456795:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955776 00000100:00100000:3.0:1787781851.456800:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955776 00010000:00010000:3.0:1787781851.456825:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 24 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.456861:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955904 00000100:00100000:3.0:1787781851.456864:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955904 00010000:00010000:3.0:1787781851.456875:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 25 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.456891:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787781851.456897:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3660:x1874624962955776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781851.456908:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781851.456919:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 25 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456928:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 25 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.456945:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.456975:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3660:x1874624962955776:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781851.456982:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787781851.456996:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787781851.457002:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962955904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781851.457009:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781851.457014:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 24 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.457021:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 24 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.457030:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.457057:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962955904:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781851.457063:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787781851.457102:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962955904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781851.457125:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962955776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781851.457346:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787781851.457353:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457367:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787781851.457370:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457378:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787781851.457384:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781851.457388:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787781851.457421:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457427:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781851.457441:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457447:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82167600/0xc6d6745c150631f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150631f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457458:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781851.457460:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781851.457462:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781851.457468:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781851.457480:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962956032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781851.457510:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781851.457540:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956032 00000100:00100000:2.0:1787781851.457543:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956032 00010000:00010000:2.0:1787781851.457565:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 24 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.457585:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787781851.457591:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962956032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781851.457598:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781851.457602:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 24 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457714:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 24 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.457725:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781851.457757:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962956032:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.457764:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787781851.457792:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962956032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781851.458724:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781851.458765:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e9cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787781851.458783:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9400/0xc6d6745c150631f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150631f2 expref: 23 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.458791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962955648 00000100:00100000:2.0:1787781851.458794:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955264:0@lo:104: 00000100:00100000:0.0:1787781851.458796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962955648 00010000:00010000:2.0:1787781851.458804:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e400/0xc6d6745c150630d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150630cc expref: 22 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.458812:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955392:0@lo:104: 00010000:00010000:2.0:1787781851.458819:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82167e00/0xc6d6745c1506307f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063078 expref: 21 pid: 6526 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.458824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787781851.458830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10406:x1874624962955648:12345-0@lo:104: 00000100:00100000:2.0:1787781851.458841:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955520:0@lo:104: 00010000:00010000:0.0:1787781851.458841:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.458899:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781851.458904:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:10406:x1874624962955648:12345-0@lo:104: Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.458911:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787781851.458925:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955648:0@lo:104: 00010000:00010000:1.0:1787781851.459041:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781851.459047:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.459054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787781851.459058:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.459065:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781851.459072:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781851.459085:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781851.459122:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.459129:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781851.459155:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.459162:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506306a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.459177:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781851.459178:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781851.459180:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781851.459187:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781851.459197:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962956160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781851.459229:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.459295:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956160 00000100:00100000:0.0:1787781851.459299:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956160 00010000:00010000:0.0:1787781851.459319:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 21 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.459342:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787781851.459348:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3660:x1874624962956160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787781851.459357:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781851.459369:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 21 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.459377:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 21 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.459389:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166800/0xc6d6745c15063071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506306a expref: 21 pid: 6525 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.459400:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781851.459443:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3660:x1874624962956160:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.459449:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787781851.459561:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962956160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781851.459711:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1874624962955136:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781851.459736:0:10406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.460134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781851.460215:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942971904 00000100:00100000:2.0:1787781851.460221:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942971904 00010000:00010000:2.0:1787781851.460242:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.460329:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:2.0:1787781851.460337:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942971904:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781851.460348:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781851.460352:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460363:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460376:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705600/0xc6d6745c15063311 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83874 expref: 10 pid: 6525 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460388:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460396:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460418:0:9533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460425:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460432:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460438:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460444:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787781851.460448:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460455:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.460557:0:10406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.460566:0:10406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460963:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460973:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039200/0xc6d6745c150633d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.460986:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781851.461040:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:2408:x1874624942971904:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 702us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781851.461048:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:1.0:1787781851.654140:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962956288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781851.654207:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.654413:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956288 00000100:00100000:0.0:1787781851.654421:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956288 00000100:00100000:0.0:1787781851.654478:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787781851.654488:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962956288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781851.654520:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781851.657036:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962956288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2542us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.657050:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787781851.657116:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962956288:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787781852.230300:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781852.873293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781852.873356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972032 00000100:00100000:3.0:1787781852.873366:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972032 00000100:00100000:3.0:1787781852.873438:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 252 00000100:00100000:3.0:1787781852.873448:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:6192:x1874624942972032:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781852.873479:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781852.873500:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838ba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781852.873533:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781852.873545:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781852.873560:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704a00, rc 0) 00000100:00100000:3.0:1787781852.873719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942972032:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 272us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781852.873734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 252 00000100:00100000:3.0:1787781852.877372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781852.877482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972160 00000100:00100000:2.0:1787781852.877492:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972160 00000100:00100000:2.0:1787781852.877548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 253 00000100:00100000:2.0:1787781852.877558:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942972160:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781852.877735:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942972160:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781852.877745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 253 00000100:00100000:3.0:1787781852.883283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781852.883704:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972288 00000100:00100000:1.0:1787781852.883714:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972288 00000100:00100000:1.0:1787781852.883765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 254 00000100:00100000:1.0:1787781852.883777:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942972288:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781852.883999:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6192:x1874624942972288:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 224us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781852.884009:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 254 00000100:00100000:2.0:1787781852.890657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781852.890964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972416 00000100:00100000:3.0:1787781852.890974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972416 00000100:00100000:3.0:1787781852.891023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 255 00000100:00100000:3.0:1787781852.891034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6754:x1874624942972416:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781852.891170:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6754:x1874624942972416:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 137us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781852.891178:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 255 00000100:00100000:3.0:1787781852.902134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781852.902172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972544 00000100:00100000:2.0:1787781852.902182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972544 00000100:00100000:2.0:1787781852.902238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 256 00000100:00100000:2.0:1787781852.902247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6754:x1874624942972544:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787781852.902504:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:6754:x1874624942972544:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 257us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781852.902513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 256 00010000:00010000:1.0:1787781853.253945:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787781853.318757:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781853.318766:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7c44e000 from 4 10000000:01000000:3.0:1787781853.318773:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781853.319101:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.319120:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.319131:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.319156:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.319223:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.319323:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.319520:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956416 00000100:00100000:0.0:1787781853.319527:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956416 00000100:00100000:1.0:1787781853.320239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787781853.320253:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962956416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.320267:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781853.320281:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150633e3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.320304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.320316:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.320326:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039000, rc 0) 00000100:00100000:1.0:1787781853.320380:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962956416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.320386:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787781853.320482:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.320499:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.320508:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.320676:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.320722:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.320746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956544 00000100:00100000:3.0:1787781853.320751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956544 00000100:00100000:2.0:1787781853.320754:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d588259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.320878:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787781853.320888:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962956544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781853.321002:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962956544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.321009:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787781853.321015:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.321043:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.321083:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.321107:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d588259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.321123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956672 00000100:00100000:3.0:1787781853.321129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956672 00000100:00100000:2.0:1787781853.321253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787781853.321260:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962956672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.321351:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962956672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.321359:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787781853.321378:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962956672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.322005:0:10506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10506:1874624962956800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.322048:0:10506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.322080:0:10506:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.322132:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956800 00000100:00100000:0.0:1787781853.322137:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956800 00000100:00100000:0.0:1787781853.322215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787781853.322224:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10506:x1874624962956800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.322321:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10506:x1874624962956800:12345-0@lo:502:llog_process_th.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.322328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787781853.322359:0:10506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10506:1874624962956800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781853.322382:0:10506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781853.322391:0:10506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781853.322393:0:10506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787781853.322403:0:10506:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d7c44e000 00000020:00000080:2.0:1787781853.322406:0:10506:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781853.322480:0:10506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10506:1874624962956928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.322515:0:10506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.323279:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962956928 00000100:00100000:3.0:1787781853.323286:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962956928 00000100:00100000:2.0:1787781853.323296:0:10506:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.323353:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787781853.323362:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10506:x1874624962956928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.323456:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:10506:x1874624962956928:12345-0@lo:502:llog_process_th.0 Request processed in 95us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.323470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787781853.323920:0:10506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10506:1874624962956928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781853.323947:0:10506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781853.323953:0:10506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781853.323956:0:10506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787781853.323962:0:10506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781853.324106:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781853.324127:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781853.324136:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.324147:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781853.324157:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781853.324159:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7236f800 from 4 10000000:01000000:3.0:1787781853.324162:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781853.324187:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.324194:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.324202:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.324220:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.324253:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.324287:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.324422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957056 00000100:00100000:2.0:1787781853.324427:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957056 00000100:00100000:2.0:1787781853.324459:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787781853.324468:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962957056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781853.324478:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781853.324491:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150633f1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.324520:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.324531:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.324540:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e600, rc 0) 00000100:00100000:2.0:1787781853.324578:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.324584:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787781853.324661:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781853.324673:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.324682:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.324739:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.324764:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.324793:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.325013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957184 00000100:00100000:3.0:1787781853.325017:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957184 00000100:00100000:3.0:1787781853.325062:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787781853.325069:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.325171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.325186:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787781853.326674:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.326738:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.326798:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.326831:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.327242:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957312 00000100:00100000:3.0:1787781853.327248:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957312 00000100:00100000:3.0:1787781853.327294:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787781853.327303:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.327402:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.327410:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787781853.327427:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.327782:0:10507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10507:1874624962957440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.327820:0:10507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.327855:0:10507:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.327896:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957440 00000100:00100000:3.0:1787781853.327900:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957440 00000100:00100000:3.0:1787781853.327933:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787781853.327941:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10507:x1874624962957440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.328012:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10507:x1874624962957440:12345-0@lo:502:llog_process_th.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.328020:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787781853.328092:0:10507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10507:1874624962957440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781853.328113:0:10507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781853.328122:0:10507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781853.328124:0:10507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787781853.328133:0:10507:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d7236f800 00000020:00000080:2.0:1787781853.328137:0:10507:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781853.328195:0:10507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10507:1874624962957568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.328224:0:10507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.328245:0:10507:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.328283:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957568 00000100:00100000:3.0:1787781853.328286:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957568 00000100:00100000:3.0:1787781853.328315:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787781853.328322:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10507:x1874624962957568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.328388:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:10507:x1874624962957568:12345-0@lo:502:llog_process_th.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.328397:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787781853.328466:0:10507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10507:1874624962957568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781853.328484:0:10507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781853.328488:0:10507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781853.328490:0:10507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787781853.328495:0:10507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781853.328645:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781853.328672:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781853.328683:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.328714:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781853.328728:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781853.328731:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d80a11800 from 4 10000000:01000000:3.0:1787781853.328734:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781853.328759:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.328767:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.328776:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.328792:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.328826:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.328844:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d7235f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.333980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957696 00000100:00100000:1.0:1787781853.333990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957696 00000100:00100000:1.0:1787781853.334047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787781853.334056:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962957696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.334071:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781853.334090:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150633ff expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.334117:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150633ff expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.334128:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633ff expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.334137:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039200, rc 0) 00000100:00100000:1.0:1787781853.334209:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962957696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (5381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.334216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787781853.334395:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.334414:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.334424:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.334503:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.334544:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.334592:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d7235f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.334637:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957824 00000100:00100000:3.0:1787781853.334643:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957824 00000100:00100000:3.0:1787781853.334676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787781853.334684:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962957824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.334804:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962957824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.334812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787781853.334865:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.334899:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.334944:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.334966:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.334979:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962957952 00000100:00100000:3.0:1787781853.334982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962957952 00000100:00100000:3.0:1787781853.335003:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787781853.335010:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962957952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.335078:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962957952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.335085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787781853.335124:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962957952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781853.335568:0:10511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10511:1874624962958080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.335714:0:10511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.335737:0:10511:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.335775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958080 00000100:00100000:3.0:1787781853.335779:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958080 00000100:00100000:3.0:1787781853.335810:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787781853.335818:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10511:x1874624962958080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.335893:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10511:x1874624962958080:12345-0@lo:502:llog_process_th.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.335906:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787781853.335978:0:10511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10511:1874624962958080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781853.336001:0:10511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781853.336010:0:10511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781853.336012:0:10511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787781853.336019:0:10511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d80a11800 00000020:00000080:0.0:1787781853.336022:0:10511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787781853.336095:0:10511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10511:1874624962958208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.336130:0:10511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.336148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958208 00000100:00100000:0.0:1787781853.336152:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958208 00000100:00100000:0.0:1787781853.336173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787781853.336179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10511:x1874624962958208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.336238:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:10511:x1874624962958208:12345-0@lo:502:llog_process_th.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.336244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787781853.336269:0:10511:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.336280:0:10511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10511:1874624962958208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781853.336301:0:10511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781853.336305:0:10511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781853.336306:0:10511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787781853.336309:0:10511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781853.336759:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781853.336779:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781853.336788:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.336799:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781853.336809:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781853.336811:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d47267800 from 4 10000000:01000000:3.0:1787781853.336814:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781853.336837:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.336845:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.336854:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.336869:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.336901:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.336919:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.336933:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958336 00000100:00100000:3.0:1787781853.336936:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958336 00000100:00100000:3.0:1787781853.336961:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787781853.336967:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962958336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.336975:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781853.336992:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506340d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.337011:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506340d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.337022:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506340d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.337031:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704c00, rc 0) 00000100:00100000:3.0:1787781853.337060:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962958336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.337066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787781853.337096:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.337109:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.337118:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.337161:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.337185:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.337206:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.337220:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958464 00000100:00100000:3.0:1787781853.337223:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958464 00000100:00100000:3.0:1787781853.337241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787781853.337246:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962958464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.337323:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962958464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.337336:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787781853.337363:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.337385:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.337417:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.337428:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.337438:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958592 00000100:00100000:3.0:1787781853.337441:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958592 00000100:00100000:3.0:1787781853.337463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787781853.337468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962958592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.337534:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962958592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.337540:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787781853.337577:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962958592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.340794:0:10512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10512:1874624962958720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.340986:0:10512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.341042:0:10512:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.342822:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958720 00000100:00100000:3.0:1787781853.342834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958720 00000100:00100000:3.0:1787781853.342902:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787781853.342913:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:10512:x1874624962958720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.343059:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:10512:x1874624962958720:12345-0@lo:502:llog_process_th.0 Request processed in 148us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.343068:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787781853.343129:0:10512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10512:1874624962958720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781853.343165:0:10512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781853.343173:0:10512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781853.343176:0:10512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787781853.343191:0:10512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d47267800 00000020:00000080:3.0:1787781853.343194:0:10512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787781853.343272:0:10512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10512:1874624962958848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.343313:0:10512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.343340:0:10512:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.343353:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958848 00000100:00100000:3.0:1787781853.343357:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958848 00000100:00100000:3.0:1787781853.343378:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787781853.343386:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:10512:x1874624962958848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.343453:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:10512:x1874624962958848:12345-0@lo:502:llog_process_th.0 Request processed in 69us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.343461:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787781853.343496:0:10512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:10512:1874624962958848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781853.343513:0:10512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781853.343518:0:10512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781853.343520:0:10512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787781853.343524:0:10512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781853.343957:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781853.343978:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781853.343988:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.343999:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781853.702234:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962959232:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702304:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702370:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962959744:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702396:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702423:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962960256:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702443:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702466:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787781853.702472:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962959360:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702495:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702511:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962959872:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702531:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702565:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962960384:0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702592:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.702645:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959744 00000100:00100000:1.0:1787781853.702652:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959744 00000100:00100000:1.0:1787781853.702708:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960256 00000100:00100000:1.0:1787781853.702720:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960256 00000100:00100000:1.0:1787781853.702737:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959872 00000100:00100000:1.0:1787781853.702739:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959872 00000100:00100000:1.0:1787781853.702752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960384 00000100:00100000:1.0:1787781853.702754:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960384 00000100:00100000:1.0:1787781853.702768:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781853.702778:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962959744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702824:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962959744:12345-0@lo:400:kworker.0 Request processed in 48us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.702831:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781853.702846:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781853.702852:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962960256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702878:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962960256:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.702884:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781853.702894:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787781853.702900:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962959872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702924:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962959872:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.702928:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787781853.702938:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787781853.702943:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962960384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781853.702978:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962960384:12345-0@lo:400:kworker.0 Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.702983:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787781853.703138:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f643c0 x1874624962959872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781853.703151:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962959872:0@lo:400:kworker.0 00010000:00080000:1.0:1787781853.703160:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f66940 x1874624962960384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781853.703168:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962960384:0@lo:400:kworker.0 00010000:00080000:1.0:1787781853.703176:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f67c00 x1874624962959744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781853.703184:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962959744:0@lo:400:kworker.0 00010000:00080000:1.0:1787781853.703192:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f66580 x1874624962960256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781853.703199:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962960256:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705370:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962958976:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705437:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705484:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962959488:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705525:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705548:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962960000:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705571:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705600:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787781853.705629:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962959104:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705654:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705673:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705707:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705729:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962960128:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705754:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.705781:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959232 00000100:00100000:3.0:1787781853.705788:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959232 00000100:00100000:3.0:1787781853.705823:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962958976 00000100:00100000:3.0:1787781853.705826:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962958976 00000100:00100000:3.0:1787781853.705836:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959488 00000100:00100000:3.0:1787781853.705838:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959488 00000100:00100000:3.0:1787781853.705851:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960000 00000100:00100000:3.0:1787781853.705853:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960000 00000100:00100000:3.0:1787781853.705865:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959616 00000100:00100000:3.0:1787781853.705867:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959616 00000100:00100000:3.0:1787781853.705878:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960128 00000100:00100000:3.0:1787781853.705880:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960128 00000100:00100000:3.0:1787781853.705897:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787781853.705905:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962959232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.705959:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962959232:12345-0@lo:400:kworker.0 Request processed in 54us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.705966:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787781853.705981:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787781853.705995:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962958976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706027:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962958976:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706033:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787781853.706044:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787781853.706050:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962959488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706074:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962959488:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706079:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787781853.706088:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787781853.706093:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962960000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706117:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962960000:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706123:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787781853.706133:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781853.706139:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962959616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706162:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962959616:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706168:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781853.706177:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787781853.706181:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962960128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706201:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962960128:12345-0@lo:400:kworker.0 Request processed in 20us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706206:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787781853.706225:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959360 00000100:00100000:3.0:1787781853.706234:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959360 00000100:00100000:3.0:1787781853.706257:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962959104 00000100:00100000:3.0:1787781853.706260:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962959104 00000100:00100000:3.0:1787781853.706272:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781853.706278:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962959360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706310:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962959360:12345-0@lo:400:kworker.0 Request processed in 32us (3814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706315:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781853.706325:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781853.706330:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962959104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706353:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962959104:12345-0@lo:400:kworker.0 Request processed in 23us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.706358:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781853.706389:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962959104:0@lo:400:kworker.0 00010000:00080000:3.0:1787781853.706401:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f67480 x1874624962959616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781853.706410:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962959616:0@lo:400:kworker.0 00010000:00080000:3.0:1787781853.706419:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f65a40 x1874624962960128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781853.706425:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962960128:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706433:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962958976:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706441:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962959488:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962960000:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706496:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962959360:0@lo:400:kworker.0 00000100:00100000:3.0:1787781853.706508:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962959232:0@lo:400:kworker.0 00000100:00100000:0.0:1787781853.706681:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781853.706704:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962960512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781853.706733:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.706757:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960512 00000100:00100000:0.0:1787781853.706761:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960512 00000100:00100000:0.0:1787781853.706783:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787781853.706788:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962960512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787781853.706809:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781853.706846:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962960512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.706852:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787781853.706879:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962960512:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787781853.706964:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781853.706968:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781853.706970:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781853.706972:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781854.213918:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962960640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781854.213986:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.214059:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960640 00000100:00100000:0.0:1787781854.214066:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960640 00000100:00100000:0.0:1787781854.214115:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787781854.214126:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962960640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781854.214156:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781854.214214:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962960640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.214222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781854.214358:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962960768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781854.214397:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787781854.214504:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42755a40 x1874624962960640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781854.214522:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962960640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781854.214557:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960768 00000100:00100000:1.0:1787781854.214561:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960768 00000100:00100000:0.0:1787781854.214632:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787781854.214640:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962960768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781854.214651:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781854.214692:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962960768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.214698:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787781854.214724:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c3c0 x1874624962960768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781854.214745:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962960768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781854.279408:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781854.732767:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962960896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781854.732834:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781854.732896:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962960896 00000100:00100000:3.0:1787781854.732903:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962960896 00000100:00100000:3.0:1787781854.732946:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787781854.732954:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962960896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781854.732982:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781854.733025:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962960896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781854.733032:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787781854.733068:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07e580 x1874624962960896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781854.733084:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962960896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781854.734854:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962961024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781854.734916:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.746365:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961024 00000100:00100000:0.0:1787781854.746378:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961024 00000100:00100000:0.0:1787781854.746529:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787781854.746541:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962961024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781854.746568:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781854.746694:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962961024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (11764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.746702:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787781854.746755:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f652c0 x1874624962961024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781854.746775:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962961024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781855.304334:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781856.139881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781856.139929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781856.139953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781856.139988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781856.140012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781856.140039:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972800 00000100:00100000:0.0:1787781856.140047:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972800 00000100:00100000:0.0:1787781856.140103:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972928 00000100:00100000:0.0:1787781856.140106:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972928 00000100:00100000:0.0:1787781856.140131:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:0.0:1787781856.140140:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942972800:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781856.140209:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942972800:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 70us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781856.140217:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:0.0:1787781856.140233:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:0.0:1787781856.140239:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942972928:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781856.140264:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942972928:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781856.140271:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00080000:0.0:1787781856.140290:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781856.140294:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781856.140456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942972672 00000100:00100000:1.0:1787781856.140461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942972672 00000100:00100000:1.0:1787781856.140498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 277 00000100:00100000:1.0:1787781856.140505:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942972672:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781856.140533:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942972672:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781856.140540:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 277 00000100:00100000:1.0:1787781856.140566:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973184 00000100:00100000:1.0:1787781856.140570:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973184 00000100:00100000:1.0:1787781856.140597:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973056 00000100:00100000:1.0:1787781856.140600:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973056 00000100:00100000:1.0:1787781856.140640:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:1.0:1787781856.140647:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942973184:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781856.140684:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942973184:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781856.140690:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:1.0:1787781856.140702:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:1.0:1787781856.140708:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942973056:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781856.140731:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942973056:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 23us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781856.140738:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00080000:0.0:1787781856.140989:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781856.140993:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787781856.325816:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781856.774822:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962961152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781856.774891:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781856.774976:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961152 00000100:00100000:1.0:1787781856.774983:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961152 00000100:00100000:1.0:1787781856.775027:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787781856.775035:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962961152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781856.775081:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781856.775126:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962961152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781856.775134:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787781856.775197:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962961152:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787781857.114244:0:10706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787781857.349841:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781858.376733:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781858.822988:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962961408:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823069:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.823072:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962961536:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.823113:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823130:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962961920:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.823143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962962048:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823165:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.823175:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823188:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962962432:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.823204:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962962560:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823220:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.823236:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823244:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962962944:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823272:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823291:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787781858.823297:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962961280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781858.823316:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823334:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962961792:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823367:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823385:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962962304:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823405:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823422:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962962816:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.823440:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.823470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961408 00000100:00100000:2.0:1787781858.823476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961408 00000100:00100000:2.0:1787781858.823819:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787781858.823953:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962961408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.824013:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962961408:12345-0@lo:400:kworker.0 Request processed in 185us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.824022:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787781858.824070:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961920 00000100:00100000:2.0:1787781858.824075:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961920 00000100:00100000:2.0:1787781858.824104:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961280 00000100:00100000:2.0:1787781858.824108:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961280 00000100:00100000:2.0:1787781858.824126:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787781858.824132:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962961920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.824168:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962961920:12345-0@lo:400:kworker.0 Request processed in 36us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.824175:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787781858.824187:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787781858.824194:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962961280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781858.824217:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781858.824248:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962961280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.824255:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787781858.824272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962432 00000100:00100000:2.0:1787781858.824275:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962432 00000100:00100000:2.0:1787781858.824301:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962944 00000100:00100000:2.0:1787781858.824303:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962944 00000100:00100000:2.0:1787781858.824313:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962304 00000100:00100000:2.0:1787781858.824315:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962304 00000100:00100000:2.0:1787781858.824326:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962816 00000100:00100000:2.0:1787781858.824328:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962816 00000100:00100000:2.0:1787781858.824340:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787781858.824427:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787781858.824439:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962961664:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824474:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.824497:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962962176:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824518:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.824530:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962962688:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824547:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.824573:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961536 00000100:00100000:2.0:1787781858.824575:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962962432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824579:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961536 00000100:00100000:1.0:1787781858.824624:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962048 00000100:00100000:1.0:1787781858.824628:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962048 00000100:00100000:2.0:1787781858.824639:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962962432:12345-0@lo:400:kworker.0 Request processed in 69us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824646:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962560 00000100:00100000:2.0:1787781858.824647:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787781858.824652:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962560 00000100:00100000:1.0:1787781858.824680:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961792 00000100:00100000:1.0:1787781858.824689:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961792 00000100:00100000:1.0:1787781858.824703:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962176 00000100:00100000:1.0:1787781858.824706:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962176 00000100:00100000:1.0:1787781858.824718:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962962688 00000100:00100000:1.0:1787781858.824720:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962962688 00000100:00100000:1.0:1787781858.824733:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787781858.824740:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962961536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824784:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962961536:12345-0@lo:400:kworker.0 Request processed in 46us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824790:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787781858.824803:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787781858.824809:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962962048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824835:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962962048:12345-0@lo:400:kworker.0 Request processed in 27us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824841:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787781858.824853:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787781858.824858:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962962560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824883:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962962560:12345-0@lo:400:kworker.0 Request processed in 25us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824889:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787781858.824900:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787781858.824906:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962961792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824932:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962961792:12345-0@lo:400:kworker.0 Request processed in 27us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824937:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787781858.824949:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787781858.824955:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962962176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.824987:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962962176:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.824993:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787781858.825004:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787781858.825010:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962962688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.825035:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962962688:12345-0@lo:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.825040:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1787781858.825080:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa1c0 x1874624962962176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781858.825094:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962962176:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.825098:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787781858.825108:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41cd83c0 x1874624962962688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781858.825116:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962962688:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.825127:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.825133:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962961536:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.825146:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962962048:0@lo:400:kworker.0 00000100:00100000:1.0:1787781858.825161:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962962560:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.825169:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962962944:12345-0@lo:400:kworker.0 Request processed in 45us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.825177:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787781858.825197:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787781858.825205:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962962304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.825233:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962962304:12345-0@lo:400:kworker.0 Request processed in 30us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.825239:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787781858.825251:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781858.825257:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962962816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.825285:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962962816:12345-0@lo:400:kworker.0 Request processed in 29us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.825291:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781858.825315:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962961664 00000100:00100000:2.0:1787781858.825320:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962961664 00000100:00100000:2.0:1787781858.825339:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787781858.826364:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962961664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.826480:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962961664:12345-0@lo:400:kworker.0 Request processed in 1134us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.826488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787781858.826541:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781858.826546:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781858.826550:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781858.826553:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781858.826578:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962961664:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.826668:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962961280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781858.826701:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962961792:0@lo:400:kworker.0 00010000:00080000:2.0:1787781858.826717:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa940 x1874624962962304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781858.826727:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962962304:0@lo:400:kworker.0 00010000:00080000:2.0:1787781858.826740:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41cdbc00 x1874624962962816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781858.826749:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962962816:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.826760:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962961920:0@lo:400:kworker.0 00010000:00080000:2.0:1787781858.826771:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ca8000 x1874624962962432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781858.826779:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962962432:0@lo:400:kworker.0 00010000:00080000:2.0:1787781858.826788:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41cd8000 x1874624962962944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781858.826796:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962962944:0@lo:400:kworker.0 00000100:00100000:2.0:1787781858.826804:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962961408:0@lo:400:kworker.0 00000100:00100000:2.0:1787781859.335004:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787781859.335024:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962963072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781859.335092:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781859.335158:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962963200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781859.335182:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781859.335298:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963072 00000100:00100000:3.0:1787781859.335305:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963072 00000100:00100000:3.0:1787781859.335339:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963200 00000100:00100000:3.0:1787781859.335342:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963200 00000100:00100000:3.0:1787781859.335359:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787781859.335368:0:8449:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787781859.335369:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962963072:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781859.335381:0:8449:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787781859.335400:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781859.335479:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962963072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781859.335552:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787781859.335574:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787781859.335581:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962963200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781859.335591:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781859.335645:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962963200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781859.335652:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787781859.335770:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43750f00 x1874624962963072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781859.335789:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962963072:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787781859.335999:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07e580 x1874624962963200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781859.336014:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962963200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781859.401387:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781859.846024:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962963328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781859.846115:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781859.846201:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963328 00000100:00100000:0.0:1787781859.846210:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963328 00000100:00100000:0.0:1787781859.846265:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787781859.846275:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962963328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781859.846310:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781859.846359:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962963328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.846367:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787781859.846413:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d680 x1874624962963328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781859.846433:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962963328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781859.846553:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962963456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781859.846590:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781859.847472:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963456 00000100:00100000:3.0:1787781859.847483:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963456 00000100:00100000:3.0:1787781859.847548:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787781859.847860:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962963456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781859.847887:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781859.847970:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962963456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 413us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781859.847978:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787781859.848060:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f0c0 x1874624962963456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781859.848082:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962963456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781860.422019:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781861.276232:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781861.276278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781861.276301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781861.276324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781861.276424:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781861.276467:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973440 00000100:00100000:1.0:1787781861.276478:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973440 00000100:00100000:1.0:1787781861.276547:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973568 00000100:00100000:1.0:1787781861.276550:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973568 00000100:00100000:1.0:1787781861.276576:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 89 00000100:00100000:1.0:1787781861.276587:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942973440:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781861.276713:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942973440:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781861.276721:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 89 00000100:00100000:1.0:1787781861.276739:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 90 00000100:00100000:1.0:1787781861.276746:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942973568:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781861.276772:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942973568:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781861.276778:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 90 00000100:00100000:1.0:1787781861.276797:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973312 00000100:00100000:1.0:1787781861.276800:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973312 00000100:00100000:1.0:1787781861.276827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 279 00000100:00100000:1.0:1787781861.276834:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942973312:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781861.276859:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942973312:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781861.276865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 279 00000100:00100000:1.0:1787781861.276897:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973696 00000100:00100000:1.0:1787781861.276900:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973696 00000100:00100000:1.0:1787781861.276926:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973824 00000100:00100000:1.0:1787781861.276929:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973824 00000100:00100000:1.0:1787781861.276949:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:1.0:1787781861.276956:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624942973696:12345-192.168.206.16@tcp:9:kworker.0 00000020:00000080:1.0:1787781861.276992:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063326 00000100:00080000:1.0:1787781861.277002:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c43226000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781861.277053:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787781861.277184:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+2:2405:x1874624942973696:12345-192.168.206.16@tcp:9:kworker.0 Request processed in 228us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781861.277191:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:1.0:1787781861.277203:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:1.0:1787781861.277209:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624942973824:12345-192.168.206.16@tcp:9:kworker.0 00000020:00000080:1.0:1787781861.277223:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506332d 00000100:00080000:1.0:1787781861.277229:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c431b1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781861.277253:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787781861.277320:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+2:2405:x1874624942973824:12345-192.168.206.16@tcp:9:kworker.0 Request processed in 111us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781861.277326:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00080000:1.0:1787781861.277341:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781861.277345:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781861.277347:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781861.277349:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787781861.277430:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781861.277436:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781861.447977:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781861.893779:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781861.893808:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962963584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781861.893899:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781861.894059:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963584 00000100:00100000:2.0:1787781861.894074:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963584 00000100:00100000:2.0:1787781861.894123:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787781861.894132:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962963584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781861.894168:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781861.894228:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962963584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781861.894235:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787781861.894285:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962963584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781862.471419:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781863.059356:0:10951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing yml_node 00010000:00010000:1.0:1787781863.494704:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781863.942387:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962963968:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942456:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942517:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942540:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942554:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962964992:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942569:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942830:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787781863.942837:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962964096:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942858:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942878:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962964608:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942913:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962965120:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.942928:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781863.942959:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963968 00000100:00100000:1.0:1787781863.942966:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963968 00000100:00100000:1.0:1787781863.943074:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787781863.943147:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962963968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943195:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962963968:12345-0@lo:400:kworker.0 Request processed in 51us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943202:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787781863.943223:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964480 00000100:00100000:1.0:1787781863.943226:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964480 00000100:00100000:1.0:1787781863.943253:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964992 00000100:00100000:1.0:1787781863.943255:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964992 00000100:00100000:1.0:1787781863.943268:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964096 00000100:00100000:1.0:1787781863.943270:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964096 00000100:00100000:1.0:1787781863.943281:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787781863.943286:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943312:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962964480:12345-0@lo:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943326:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787781863.943337:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787781863.943341:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962964992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943363:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962964992:12345-0@lo:400:kworker.0 Request processed in 22us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943368:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787781863.943377:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787781863.943381:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962964096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943399:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962964096:12345-0@lo:400:kworker.0 Request processed in 18us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943404:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787781863.943426:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964608 00000100:00100000:1.0:1787781863.943428:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964608 00000100:00100000:1.0:1787781863.943449:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965120 00000100:00100000:1.0:1787781863.943451:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965120 00000100:00100000:1.0:1787781863.943468:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787781863.943473:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962964608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943497:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962964608:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943502:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787781863.943510:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787781863.943515:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962965120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943533:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962965120:12345-0@lo:400:kworker.0 Request processed in 18us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.943538:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787781863.943563:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781863.943566:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781863.943569:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781863.943835:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962964096:0@lo:400:kworker.0 00010000:00080000:1.0:1787781863.943848:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ca92c0 x1874624962964608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781863.943858:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962964608:0@lo:400:kworker.0 00010000:00080000:1.0:1787781863.943866:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd7c00 x1874624962965120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781863.943873:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962965120:0@lo:400:kworker.0 00000100:00100000:1.0:1787781863.943883:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962963968:0@lo:400:kworker.0 00010000:00080000:1.0:1787781863.943890:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cabc00 x1874624962964480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781863.943897:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962964480:0@lo:400:kworker.0 00010000:00080000:1.0:1787781863.943904:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd5e00 x1874624962964992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781863.943911:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962964992:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.945792:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962963712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.945868:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.945913:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962964224:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.945938:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.945958:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962964736:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.945979:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.945995:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962965248:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946013:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.946037:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787781863.946044:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962963840:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946066:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.946083:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962964352:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946101:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.946117:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962964864:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946134:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.946148:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962965376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781863.946166:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781863.946257:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964224 00000100:00100000:0.0:1787781863.946264:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964224 00000100:00100000:0.0:1787781863.946298:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965376 00000100:00100000:0.0:1787781863.946301:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965376 00000100:00100000:0.0:1787781863.946314:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787781863.946321:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962964224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946368:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962964224:12345-0@lo:400:kworker.0 Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946376:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787781863.946398:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781863.946403:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962965376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787781863.946425:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781863.946455:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962965376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946461:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781863.946494:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962965376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781863.946505:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962964224:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946530:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963840 00000100:00100000:0.0:1787781863.946533:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963840 00000100:00100000:0.0:1787781863.946554:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964352 00000100:00100000:0.0:1787781863.946557:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964352 00000100:00100000:0.0:1787781863.946574:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964864 00000100:00100000:0.0:1787781863.946576:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964864 00000100:00100000:0.0:1787781863.946625:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787781863.946642:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962963840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946676:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624962963840:12345-0@lo:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946682:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787781863.946694:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787781863.946700:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962964352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946724:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962964352:12345-0@lo:400:kworker.0 Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946730:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787781863.946740:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787781863.946745:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962964864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946778:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962964864:12345-0@lo:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946784:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787781863.946808:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624962963840:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946817:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962964352:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946824:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962964864:0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946847:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962964736 00000100:00100000:0.0:1787781863.946850:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962964736 00000100:00100000:0.0:1787781863.946877:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965248 00000100:00100000:0.0:1787781863.946880:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965248 00000100:00100000:0.0:1787781863.946894:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781863.946899:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962964736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946933:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962964736:12345-0@lo:400:kworker.0 Request processed in 34us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946939:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781863.946950:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787781863.946955:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962965248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781863.946982:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962965248:12345-0@lo:400:kworker.0 Request processed in 27us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781863.946987:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787781863.947013:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa1c0 x1874624962964736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781863.947023:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962964736:0@lo:400:kworker.0 00010000:00080000:0.0:1787781863.947032:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4beab480 x1874624962965248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781863.947048:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962965248:0@lo:400:kworker.0 00000100:00080000:0.0:1787781863.947074:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781863.947078:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781863.947081:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781863.947636:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962963712 00000100:00100000:2.0:1787781863.947648:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962963712 00000100:00100000:2.0:1787781863.947681:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787781863.947689:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962963712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781863.947737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962963712:12345-0@lo:400:kworker.0 Request processed in 48us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781863.947743:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787781863.947781:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962963712:0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.453934:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781864.455992:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781864.456027:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962965632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781864.456105:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781864.456572:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965632 00000100:00100000:0.0:1787781864.456582:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965632 00000100:00100000:0.0:1787781864.456664:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781864.456673:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962965632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781864.456707:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781864.456772:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962965632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781864.456779:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787781864.456870:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c780 x1874624962965632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781864.456890:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962965632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781864.460596:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962965504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781864.460822:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781864.463846:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965504 00000100:00100000:3.0:1787781864.463859:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965504 00000100:00100000:0.0:1787781864.465646:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781864.465661:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962965504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781864.465691:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781864.465766:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962965504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (4945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781864.465773:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787781864.465853:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c437503c0 x1874624962965504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781864.465871:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962965504:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781864.518026:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781864.966415:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962965760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781864.966488:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781864.966640:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965760 00000100:00100000:3.0:1787781864.966648:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965760 00000100:00100000:3.0:1787781864.966702:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787781864.966726:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962965760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781864.966754:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781864.966807:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962965760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781864.966814:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787781864.966955:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07cf00 x1874624962965760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781864.966982:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962965760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781864.967125:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781864.971666:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962965888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781864.971765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781864.974505:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962965888 00000100:00100000:0.0:1787781864.974519:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962965888 00000100:00100000:0.0:1787781864.974591:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781864.974601:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962965888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781864.974672:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781864.976310:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962965888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1704us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781864.976323:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787781864.979454:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43752580 x1874624962965888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781864.979481:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962965888:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787781865.541973:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781866.381594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781866.381734:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781866.381781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781866.382060:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974208 00000100:00100000:2.0:1787781866.382070:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974208 00000100:00100000:2.0:1787781866.382131:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974080 00000100:00100000:2.0:1787781866.382134:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974080 00000100:00100000:2.0:1787781866.382156:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 97 00000100:00100000:2.0:1787781866.382165:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942974208:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781866.382236:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942974208:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 72us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781866.382244:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 97 00000100:00080000:0.0:1787781866.383063:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781866.383069:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781866.383264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942973952 00000100:00100000:1.0:1787781866.383271:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942973952 00000100:00100000:1.0:1787781866.383312:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 281 00000100:00100000:1.0:1787781866.383320:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942973952:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781866.383364:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942973952:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 45us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781866.383370:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 281 00000100:00100000:0.0:1787781866.383781:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 98 00000100:00100000:0.0:1787781866.383923:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942974080:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781866.383966:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942974080:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 177us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781866.383973:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 98 00010000:00010000:3.0:1787781866.566340:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781867.014345:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962966016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781867.014416:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781867.014493:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966016 00000100:00100000:1.0:1787781867.014500:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966016 00000100:00100000:1.0:1787781867.014542:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787781867.014551:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962966016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781867.014582:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781867.014656:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962966016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781867.014664:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787781867.014708:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962966016:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787781867.018330:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:1.0:1787781867.018342:0:9524:0:(genops.c:885:class_export_put()) final put ffff993c431b1800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:3.0:1787781867.019027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff993c431b1800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-OST0001 00000020:00000080:3.0:1787781867.019089:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c431b1000 for lustre-OST0001 00000001:00100000:1.0:1787781867.025029:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:1.0:1787781867.025038:0:8439:0:(genops.c:885:class_export_put()) final put ffff993c43222000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:0.0:1787781867.025099:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff993c43222000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-OST0000 00000020:00000080:0.0:1787781867.025134:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c43226000 for lustre-OST0000 00000001:02000400:2.0:1787781867.516255:0:11134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.56 00010000:00010000:1.0:1787781867.590015:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781868.624695:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781869.064780:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781869.065001:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781869.065265:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966144 00000100:00100000:2.0:1787781869.065278:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966144 00000100:00100000:2.0:1787781869.065397:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787781869.065410:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962966144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781869.065455:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781869.065515:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962966144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.065523:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787781869.066291:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781869.066307:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962966272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066353:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.066398:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966272 00000100:00100000:1.0:1787781869.066403:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966272 00000100:00100000:1.0:1787781869.066436:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787781869.066445:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962966272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066490:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962966272:12345-0@lo:400:kworker.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.066496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787781869.066547:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962966272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066687:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962966400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066720:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.066755:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966400 00000100:00100000:1.0:1787781869.066760:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966400 00000100:00100000:1.0:1787781869.066790:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787781869.066797:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962966400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066831:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962966400:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.066837:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787781869.066862:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962966400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066905:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781869.066919:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962966784:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.066945:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.066969:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966784 00000100:00100000:1.0:1787781869.066972:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966784 00000100:00100000:1.0:1787781869.067005:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787781869.067011:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962966784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067042:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962966784:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.067048:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787781869.067061:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781869.067077:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962966784:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067103:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962966912:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067125:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.067144:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966912 00000100:00100000:1.0:1787781869.067146:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966912 00000100:00100000:1.0:1787781869.067167:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787781869.067173:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962966912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067200:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962966912:12345-0@lo:400:kworker.0 Request processed in 28us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.067206:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1787781869.067221:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787781869.067239:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa1c0 x1874624962966912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781869.067251:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962966912:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067286:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781869.067292:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962967296:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067321:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.067343:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967296 00000100:00100000:1.0:1787781869.067346:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967296 00000100:00100000:1.0:1787781869.067372:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787781869.067378:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962967296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067411:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962967296:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.067417:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787781869.067430:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781869.067447:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962967296:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067479:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962967424:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.067503:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.067525:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967424 00000100:00100000:1.0:1787781869.067529:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967424 00000100:00100000:1.0:1787781869.067552:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787781869.067558:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962967424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.070895:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962967424:12345-0@lo:400:kworker.0 Request processed in 3320us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.070914:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787781869.070974:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787781869.071029:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cabc00 x1874624962967424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781869.071130:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962967424:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.071307:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962966656:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.071374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.071845:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962967168:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.071880:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.071911:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962967680:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.071919:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967168 00000100:00100000:0.0:1787781869.071930:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967168 00000100:00100000:1.0:1787781869.071935:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.071983:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781869.072010:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787781869.072019:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967680 00000100:00100000:1.0:1787781869.072020:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962966528:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072028:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967680 00000100:00100000:0.0:1787781869.072063:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787781869.072071:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.072078:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962967168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.072096:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962967040:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.072126:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.072152:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962967552:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072169:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962967168:12345-0@lo:400:kworker.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781869.072180:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.072184:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787781869.072203:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ca9e00 x1874624962967168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781869.072211:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967040 00000100:00100000:0.0:1787781869.072216:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967040 00000100:00100000:1.0:1787781869.072217:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962967168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072240:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967552 00000100:00100000:0.0:1787781869.072244:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967552 00000100:00100000:0.0:1787781869.072274:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781869.072283:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962967680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072350:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962967680:12345-0@lo:400:kworker.0 Request processed in 68us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781869.072359:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781869.072370:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787781869.072376:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962967040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072403:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962967040:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781869.072408:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787781869.072418:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787781869.072424:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962967552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.072449:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962967552:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781869.072455:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787781869.072474:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781869.072478:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781869.075469:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966656 00000100:00100000:3.0:1787781869.075491:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966656 00000100:00100000:3.0:1787781869.075569:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781869.076771:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962966656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781869.076898:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962966656:12345-0@lo:400:kworker.0 Request processed in 147us (5524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781869.076909:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781869.076965:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962966528 00000100:00100000:3.0:1787781869.076973:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962966528 00000100:00100000:3.0:1787781869.077026:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787781869.077033:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962966528:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787781869.078136:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa1c0 x1874624962967040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781869.078162:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962967040:0@lo:400:kworker.0 00010000:00080000:1.0:1787781869.078183:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cabc00 x1874624962967552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781869.078194:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962967552:0@lo:400:kworker.0 00000100:00100000:1.0:1787781869.078209:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962966656:0@lo:400:kworker.0 00010000:00080000:1.0:1787781869.078223:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa940 x1874624962967680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781869.078243:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962967680:0@lo:400:kworker.0 00000100:00100000:3.0:1787781869.078863:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962966528:12345-0@lo:400:kworker.0 Request processed in 1827us (6789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781869.078875:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787781869.079257:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962966528:0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.575550:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781869.575580:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962967808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781869.575698:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781869.576158:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781869.576172:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962967936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781869.576212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781869.576300:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967808 00000100:00100000:3.0:1787781869.576309:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967808 00000100:00100000:3.0:1787781869.576367:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962967936 00000100:00100000:3.0:1787781869.576370:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962967936 00000100:00100000:3.0:1787781869.576388:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781869.576398:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962967808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781869.576449:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781869.576512:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962967808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781869.576520:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781869.576538:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787781869.576544:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962967936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781869.576554:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781869.576587:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962967936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781869.576593:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787781869.576672:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43751a40 x1874624962967936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781869.576691:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962967936:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787781869.577429:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f840 x1874624962967808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781869.577448:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962967808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781869.640197:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781870.085898:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781870.085926:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962968064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781870.086015:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781870.086306:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962968192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781870.086336:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781870.086470:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968064 00000100:00100000:0.0:1787781870.086480:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968064 00000100:00100000:0.0:1787781870.086541:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968192 00000100:00100000:0.0:1787781870.086544:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968192 00000100:00100000:0.0:1787781870.086559:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781870.086569:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962968064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781870.086635:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781870.086689:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962968064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781870.086697:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781870.086734:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787781870.086740:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962968192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781870.086749:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781870.086773:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962968192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781870.086778:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787781870.086855:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43750780 x1874624962968192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781870.086877:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962968192:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787781870.086889:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962968064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781870.086900:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962968064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781870.662309:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787781870.855410:0:11232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.56 00000100:00100000:0.0:1787781871.495981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781871.496037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781871.496061:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974464 00000100:00100000:1.0:1787781871.496074:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974464 00000100:00100000:0.0:1787781871.496079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00080000:0.0:1787781871.496123:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781871.496233:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974592 00000100:00100000:3.0:1787781871.496238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974592 00000100:00100000:2.0:1787781871.496323:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974336 00000100:00100000:2.0:1787781871.496338:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974336 00000100:00100000:2.0:1787781871.496379:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 283 00000100:00100000:2.0:1787781871.496392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942974336:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781871.496487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2407:x1874624942974336:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 98us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781871.496496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 283 00000100:00100000:3.0:1787781871.497448:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 105 00000100:00100000:3.0:1787781871.497466:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942974464:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781871.497532:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942974464:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 73us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781871.497540:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 105 00000100:00100000:3.0:1787781871.497556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 106 00000100:00100000:3.0:1787781871.497564:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942974592:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781871.497598:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942974592:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 35us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781871.497635:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 106 00000100:00080000:0.0:1787781871.498279:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787781871.685846:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781872.137046:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781872.137068:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962968320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781872.137136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781872.137159:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968320 00000100:00100000:3.0:1787781872.137165:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968320 00000100:00100000:3.0:1787781872.137205:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787781872.137214:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962968320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781872.137245:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781872.137300:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962968320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781872.137307:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787781872.137821:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962968320:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781872.710432:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781873.163319:0:11329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.56 00010000:00010000:1.0:1787781873.734691:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781874.188648:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962968448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188753:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.188808:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962968960:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188834:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.188850:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962969472:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188868:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.188881:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962969984:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188895:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.188917:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787781874.188922:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962968832:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188941:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.188955:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962969344:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.188970:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189187:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962969856:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189225:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189259:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962968704:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189282:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189299:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962969216:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189314:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189327:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624962969728:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189354:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189376:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787781874.189381:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962968576:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189399:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189413:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962969088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189429:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189436:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962969600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189450:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.189472:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968448 00000100:00100000:0.0:1787781874.189491:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968448 00000100:00100000:0.0:1787781874.189544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787781874.189551:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962968448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.189638:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962968448:12345-0@lo:400:kworker.0 Request processed in 86us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781874.189645:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787781874.189684:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968960 00000100:00100000:0.0:1787781874.189688:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968960 00000100:00100000:0.0:1787781874.189712:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968704 00000100:00100000:0.0:1787781874.189715:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968704 00000100:00100000:1.0:1787781874.190131:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787781874.190143:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962968960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190190:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962968960:12345-0@lo:400:kworker.0 Request processed in 52us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190195:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787781874.190211:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787781874.190216:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962968704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190244:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962968704:12345-0@lo:400:kworker.0 Request processed in 29us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190249:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787781874.190266:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969472 00000100:00100000:1.0:1787781874.190270:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969472 00000100:00100000:1.0:1787781874.190299:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969984 00000100:00100000:1.0:1787781874.190302:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969984 00000100:00100000:1.0:1787781874.190313:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969344 00000100:00100000:1.0:1787781874.190315:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969344 00000100:00100000:1.0:1787781874.190326:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969856 00000100:00100000:1.0:1787781874.190328:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969856 00000100:00100000:1.0:1787781874.190339:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781874.190344:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962969472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190371:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962969472:12345-0@lo:400:kworker.0 Request processed in 27us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190376:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781874.190386:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781874.190391:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962969984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190428:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962969984:12345-0@lo:400:kworker.0 Request processed in 37us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190434:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781874.190443:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787781874.190460:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962969344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190483:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962969344:12345-0@lo:400:kworker.0 Request processed in 35us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190488:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787781874.190498:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781874.190503:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962969856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190522:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962969856:12345-0@lo:400:kworker.0 Request processed in 19us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190526:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781874.190547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968832 00000100:00100000:1.0:1787781874.190550:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968832 00000100:00100000:1.0:1787781874.190564:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969216 00000100:00100000:1.0:1787781874.190568:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969216 00000100:00100000:1.0:1787781874.190592:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969728 00000100:00100000:1.0:1787781874.190595:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969728 00000100:00100000:1.0:1787781874.190628:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962968576 00000100:00100000:1.0:1787781874.190631:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962968576 00000100:00100000:1.0:1787781874.190642:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969088 00000100:00100000:1.0:1787781874.190644:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969088 00000100:00100000:1.0:1787781874.190654:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962969600 00000100:00100000:1.0:1787781874.190657:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962969600 00000100:00100000:1.0:1787781874.190667:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787781874.190672:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962968832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190701:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962968832:12345-0@lo:400:kworker.0 Request processed in 29us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190712:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787781874.190723:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787781874.190727:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962969216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962969216:12345-0@lo:400:kworker.0 Request processed in 37us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190769:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787781874.190778:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787781874.190783:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624962969728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190802:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624962969728:12345-0@lo:400:kworker.0 Request processed in 19us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190806:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787781874.190814:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787781874.190819:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962968576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190853:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962968576:12345-0@lo:400:kworker.0 Request processed in 34us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190858:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787781874.190867:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787781874.190872:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962969088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962969088:12345-0@lo:400:kworker.0 Request processed in 20us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190896:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787781874.190904:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787781874.190908:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962969600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781874.190927:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962969600:12345-0@lo:400:kworker.0 Request processed in 19us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781874.190938:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787781874.192299:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962968832:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.192334:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e41a40 x1874624962969344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.192346:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962969344:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.192358:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e43840 x1874624962969856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.192366:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962969856:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.192378:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962968448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.192389:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962968960:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.192401:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e40780 x1874624962969472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.192410:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962969472:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.192421:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e41680 x1874624962969984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.192429:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962969984:0@lo:400:kworker.0 00000100:00080000:0.0:1787781874.193236:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781874.193244:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781874.193248:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781874.193252:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781874.193289:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962968576:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.193303:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962969088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.193316:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962969600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.193327:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962968704:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.193354:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e412c0 x1874624962969216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.193363:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962969216:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.193374:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e40f00 x1874624962969728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.193381:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624962969728:0@lo:400:kworker.0 00000100:00100000:2.0:1787781874.193787:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962970112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781874.193862:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781874.193917:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970112 00000100:00100000:2.0:1787781874.193924:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970112 00000100:00100000:2.0:1787781874.193967:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787781874.196289:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962970112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781874.196351:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781874.199130:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962970112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5048us (5161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781874.199149:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787781874.199253:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962970112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781874.695995:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962970240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781874.696086:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781874.696256:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970240 00000100:00100000:3.0:1787781874.696266:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970240 00000100:00100000:3.0:1787781874.696328:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781874.696338:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962970240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781874.696374:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781874.696433:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962970240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.696441:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787781874.696484:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962970240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781874.696504:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962970240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781874.716604:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781874.716651:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781874.716797:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781874.716954:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970368 00000100:00100000:3.0:1787781874.716963:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970368 00000100:00100000:3.0:1787781874.717022:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787781874.717032:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962970368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781874.717074:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781874.721518:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962970368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4475us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.721537:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787781874.721827:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962970368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781874.721857:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962970368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787781874.760676:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781875.046782:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 18:04:32 EDT 2026 00000100:00100000:1.0:1787781875.205833:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781875.205863:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962970496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781875.205951:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781875.206024:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970496 00000100:00100000:1.0:1787781875.206033:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970496 00000100:00100000:1.0:1787781875.206088:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781875.206096:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962970496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781875.206340:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781875.206351:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962970624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781875.206385:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781875.206416:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970624 00000100:00100000:3.0:1787781875.206420:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970624 00000100:00100000:3.0:1787781875.206445:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787781875.206451:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962970624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781875.206477:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781875.206521:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962970624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781875.206527:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787781875.206579:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f840 x1874624962970624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781875.206599:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962970624:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781875.206723:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781875.206764:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962970496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 668us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781875.206770:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787781875.206848:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cab0c0 x1874624962970496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781875.206885:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962970496:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787781875.781961:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781876.617068:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781876.617120:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781876.617154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781876.617185:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974720 00000100:00100000:0.0:1787781876.617195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974720 00000100:00100000:0.0:1787781876.617252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 285 00000100:00100000:0.0:1787781876.617262:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2406:x1874624942974720:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781876.617482:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2406:x1874624942974720:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 220us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781876.617491:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 285 00000100:00100000:3.0:1787781876.617596:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974848 00000100:00100000:3.0:1787781876.617651:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974848 00000100:00100000:3.0:1787781876.617731:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942974976 00000100:00100000:3.0:1787781876.617735:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942974976 00000100:00100000:3.0:1787781876.617768:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 113 00000100:00100000:3.0:1787781876.617779:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942974848:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781876.617857:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942974848:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 78us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781876.617883:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 114 00000100:00100000:3.0:1787781876.617894:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 113 00000100:00100000:0.0:1787781876.617901:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942974976:12345-192.168.206.16@tcp:400:kworker.0 00000100:00080000:3.0:1787781876.617955:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781876.617962:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781876.617969:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942974976:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 69us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781876.617980:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 114 00010000:00010000:3.0:1787781876.808689:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781877.254817:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781877.254847:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962970752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787781877.255169:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781877.255244:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970752 00000100:00100000:2.0:1787781877.255252:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970752 00000100:00100000:2.0:1787781877.255301:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787781877.255310:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962970752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781877.255347:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781877.255391:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962970752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781877.255398:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787781877.255527:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962970752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781877.829954:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781878.853832:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781879.302067:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781879.302088:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962971136:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.302150:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.302226:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962971264:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.302273:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.302331:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781879.302337:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962971648:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.302358:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.302408:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962971776:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.302431:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.302461:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971776 00000100:00100000:1.0:1787781879.302467:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971776 00000100:00100000:1.0:1787781879.302510:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787781879.302904:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962971008:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.302938:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781879.302957:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962971520:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.302975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781879.302990:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787781879.302995:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962970880:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303022:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781879.303060:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962971392:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303080:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781879.303108:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971264 00000100:00100000:3.0:1787781879.303112:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971264 00000100:00100000:3.0:1787781879.303138:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971648 00000100:00100000:3.0:1787781879.303140:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971648 00000100:00100000:3.0:1787781879.303153:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971008 00000100:00100000:3.0:1787781879.303155:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971008 00000100:00100000:3.0:1787781879.303166:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971520 00000100:00100000:3.0:1787781879.303168:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971520 00000100:00100000:3.0:1787781879.303183:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787781879.303190:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962971264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303242:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624962971264:12345-0@lo:400:kworker.0 Request processed in 52us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781879.303249:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787781879.303276:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787781879.303282:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962971648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303313:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624962971648:12345-0@lo:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781879.303319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787781879.303332:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787781879.303338:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962971008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303368:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962971008:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781879.303374:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787781879.303397:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787781879.303404:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962971520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303428:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962971520:12345-0@lo:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781879.303433:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787781879.303451:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781879.303455:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781879.303458:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781879.303481:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962971008:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303489:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962971520:0@lo:400:kworker.0 00010000:00080000:3.0:1787781879.303517:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a6580 x1874624962971648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781879.303540:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624962971648:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303560:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624962971264:0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.303590:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971136 00000100:00100000:2.0:1787781879.303597:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971136 00000100:00100000:2.0:1787781879.303648:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971392 00000100:00100000:2.0:1787781879.303652:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971392 00000100:00100000:2.0:1787781879.303666:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781879.303673:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962971136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.303723:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962971136:12345-0@lo:400:kworker.0 Request processed in 50us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781879.303729:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781879.303744:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787781879.303751:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962971392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.303796:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962971392:12345-0@lo:400:kworker.0 Request processed in 46us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781879.303803:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787781879.303853:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962971904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781879.303882:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781879.303916:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962971904 00000100:00100000:2.0:1787781879.303919:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962971904 00000100:00100000:3.0:1787781879.303933:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962971392:0@lo:400:kworker.0 00000100:00100000:3.0:1787781879.303960:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962971136:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304093:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962971776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304138:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962971776:12345-0@lo:400:kworker.0 Request processed in 1621us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.304146:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787781879.304170:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962970880 00000100:00100000:1.0:1787781879.304174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962970880 00000100:00100000:2.0:1787781879.304193:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787781879.304200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787781879.304207:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962971904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781879.304213:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962970880:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1787781879.304236:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787781879.304253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962970880:12345-0@lo:400:kworker.0 Request processed in 44us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.304260:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787781879.304288:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962971904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.304382:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962972160:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304408:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.304429:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781879.304434:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962972288:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304455:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.304477:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972160 00000100:00100000:1.0:1787781879.304481:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972160 00000100:00100000:1.0:1787781879.304505:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972288 00000100:00100000:1.0:1787781879.304508:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972288 00000100:00100000:1.0:1787781879.304552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787781879.304559:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962972160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304622:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962972160:12345-0@lo:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.304630:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787781879.304657:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781879.304664:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962972288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304693:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962972288:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.304699:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1787781879.304745:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a4f00 x1874624962972288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.304756:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962972288:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304766:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962972160:0@lo:400:kworker.0 00000100:00080000:1.0:1787781879.304785:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781879.304789:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781879.304813:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972032:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304840:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.304858:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972544:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304878:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.304901:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962970880:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304913:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781879.304919:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962972416:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.304940:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.304964:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972032 00000100:00100000:1.0:1787781879.304967:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972032 00000100:00100000:1.0:1787781879.305001:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972544 00000100:00100000:1.0:1787781879.305004:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972544 00000100:00100000:1.0:1787781879.305015:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972416 00000100:00100000:1.0:1787781879.305017:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972416 00000100:00100000:1.0:1787781879.305031:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781879.305039:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.305243:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972032:12345-0@lo:400:kworker.0 Request processed in 205us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.305250:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781879.305262:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787781879.305269:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.305292:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972544:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.305298:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787781879.305306:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787781879.305311:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962972416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.305334:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962972416:12345-0@lo:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.305340:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787781879.305358:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781879.305360:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781879.305505:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a7840 x1874624962972416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.305518:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962972416:0@lo:400:kworker.0 00010000:00080000:1.0:1787781879.305531:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a4780 x1874624962972032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.305540:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972032:0@lo:400:kworker.0 00010000:00080000:1.0:1787781879.305568:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a5680 x1874624962972544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.305576:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972544:0@lo:400:kworker.0 00010000:00080000:1.0:1787781879.305626:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a52c0 x1874624962971776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.305635:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962971776:0@lo:400:kworker.0 00000100:00100000:1.0:1787781879.305877:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962971904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781879.310977:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787781879.813956:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781879.815237:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962972800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781879.815460:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781879.815565:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781879.815597:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781879.815668:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972800 00000100:00100000:1.0:1787781879.815679:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972800 00000100:00100000:1.0:1787781879.815748:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972672 00000100:00100000:1.0:1787781879.815751:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972672 00000100:00100000:1.0:1787781879.815777:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781879.815788:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962972800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787781879.815829:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781879.815895:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962972800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.815903:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781879.815935:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787781879.815944:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962972672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781879.815955:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787781879.815981:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c780 x1874624962972800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781879.815985:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962972672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781879.816001:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787781879.816024:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962972800:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787781879.816050:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f840 x1874624962972672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781879.816066:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962972672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781879.881226:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781880.325826:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781880.325856:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781880.325945:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781880.326032:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962972928 00000100:00100000:3.0:1787781880.326041:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962972928 00000100:00100000:3.0:1787781880.326101:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787781880.326111:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781880.326385:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781880.326445:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962972928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781880.326453:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787781880.326504:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962972928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781880.326527:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962972928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781880.330109:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962973056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781880.330212:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781880.334824:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973056 00000100:00100000:1.0:1787781880.334851:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973056 00000100:00100000:1.0:1787781880.336330:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787781880.336356:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962973056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787781880.336401:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781880.336507:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962973056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (6294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781880.336515:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787781880.336813:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a52c0 x1874624962973056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781880.336840:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962973056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787781880.905566:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781881.742882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781881.742915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781881.742949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781881.742977:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975232 00000100:00100000:2.0:1787781881.742986:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975232 00000100:00100000:2.0:1787781881.743043:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975360 00000100:00100000:2.0:1787781881.743047:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975360 00000100:00100000:2.0:1787781881.743073:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:2.0:1787781881.743082:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942975232:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781881.743154:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942975232:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781881.743162:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:2.0:1787781881.743179:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00100000:2.0:1787781881.743185:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942975360:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781881.743212:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942975360:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781881.743219:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00080000:2.0:1787781881.743235:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781881.743248:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781881.745028:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975104 00000100:00100000:0.0:1787781881.745052:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975104 00000100:00100000:0.0:1787781881.745116:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 287 00000100:00100000:0.0:1787781881.745126:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942975104:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781881.745198:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624942975104:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 73us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781881.745205:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 287 00010000:00010000:1.0:1787781881.926187:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781882.373903:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781882.373940:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962973184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781882.374014:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781882.374120:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973184 00000100:00100000:2.0:1787781882.374128:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973184 00000100:00100000:2.0:1787781882.374178:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787781882.374186:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962973184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781882.374217:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781882.374274:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962973184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781882.374280:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787781882.374362:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962973184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781882.950865:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781883.974692:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781884.423628:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962973312:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.423696:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781884.423888:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962973696:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.423922:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424032:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962973824:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424063:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424087:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962974336:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424109:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424128:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962974848:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424147:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424176:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962973568:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424198:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424214:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962974080:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424234:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424247:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962974592:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424265:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424281:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787781884.424287:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962973440:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424317:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424333:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962973952:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424350:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424359:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962974464:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424375:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424383:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962974976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781884.424400:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781884.424657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973312 00000100:00100000:2.0:1787781884.424664:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973312 00000100:00100000:2.0:1787781884.424711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787781884.424720:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962973312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424774:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962973312:12345-0@lo:400:kworker.0 Request processed in 56us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.424782:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787781884.424812:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973696 00000100:00100000:2.0:1787781884.424817:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973696 00000100:00100000:2.0:1787781884.424834:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974080 00000100:00100000:2.0:1787781884.424836:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974080 00000100:00100000:2.0:1787781884.424857:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974592 00000100:00100000:2.0:1787781884.424860:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974592 00000100:00100000:2.0:1787781884.424871:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973440 00000100:00100000:2.0:1787781884.424873:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973440 00000100:00100000:2.0:1787781884.424881:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973952 00000100:00100000:2.0:1787781884.424883:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973952 00000100:00100000:2.0:1787781884.424894:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974464 00000100:00100000:2.0:1787781884.424896:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974464 00000100:00100000:2.0:1787781884.424908:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787781884.424914:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962973696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.424956:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962973696:12345-0@lo:400:kworker.0 Request processed in 42us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.424962:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787781884.424974:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787781884.424980:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962974080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425009:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962974080:12345-0@lo:400:kworker.0 Request processed in 29us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425015:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787781884.425025:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787781884.425031:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962974592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425056:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962974592:12345-0@lo:400:kworker.0 Request processed in 26us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425063:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787781884.425073:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787781884.425078:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962973440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425100:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962973440:12345-0@lo:400:kworker.0 Request processed in 22us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425105:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787781884.425114:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787781884.425120:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962973952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425143:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962973952:12345-0@lo:400:kworker.0 Request processed in 23us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425148:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787781884.425158:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787781884.425164:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962974464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425199:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962974464:12345-0@lo:400:kworker.0 Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425205:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787781884.425226:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973824 00000100:00100000:2.0:1787781884.425230:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973824 00000100:00100000:2.0:1787781884.425248:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962973568 00000100:00100000:2.0:1787781884.425251:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962973568 00000100:00100000:2.0:1787781884.425263:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974976 00000100:00100000:2.0:1787781884.425267:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974976 00000100:00100000:2.0:1787781884.425278:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787781884.425284:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962973824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425316:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962973824:12345-0@lo:400:kworker.0 Request processed in 32us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425323:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787781884.425334:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787781884.425340:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962973568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425363:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624962973568:12345-0@lo:400:kworker.0 Request processed in 24us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425368:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787781884.425378:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781884.425383:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962974976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781884.425404:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781884.425431:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962974976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425437:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781884.425454:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974336 00000100:00100000:2.0:1787781884.425458:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974336 00000100:00100000:2.0:1787781884.425491:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974848 00000100:00100000:2.0:1787781884.425494:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974848 00000100:00100000:2.0:1787781884.425530:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787781884.425536:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962974336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425567:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962974336:12345-0@lo:400:kworker.0 Request processed in 32us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425574:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787781884.425586:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787781884.425591:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962974848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425639:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962974848:12345-0@lo:400:kworker.0 Request processed in 47us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781884.425645:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787781884.425663:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781884.425667:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781884.425670:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781884.425673:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781884.425807:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962973440:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425819:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962973952:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425829:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962974464:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425842:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962974976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781884.425852:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962973568:0@lo:400:kworker.0 00010000:00080000:2.0:1787781884.425863:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a43c0 x1874624962974080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781884.425874:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962974080:0@lo:400:kworker.0 00010000:00080000:2.0:1787781884.425893:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6fc00 x1874624962974592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781884.425902:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962974592:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425946:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962973312:0@lo:400:kworker.0 00000100:00100000:2.0:1787781884.425956:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962973824:0@lo:400:kworker.0 00010000:00080000:2.0:1787781884.425966:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a4000 x1874624962974336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781884.425975:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962974336:0@lo:400:kworker.0 00010000:00080000:2.0:1787781884.425984:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6e1c0 x1874624962974848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781884.425993:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962974848:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.426670:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962973696:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.426683:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962974208:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.426725:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781884.426749:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962974720:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.426769:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781884.426853:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974208 00000100:00100000:3.0:1787781884.427031:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974208 00000100:00100000:3.0:1787781884.427088:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962974720 00000100:00100000:3.0:1787781884.427092:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962974720 00000100:00080000:1.0:1787781884.427141:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781884.427146:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781884.427456:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787781884.427470:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962974208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781884.427594:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962974208:12345-0@lo:400:kworker.0 Request processed in 129us (868us total) trans 0 rc 0/0 00010000:00080000:2.0:1787781884.428088:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a6580 x1874624962974208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781884.428102:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962974208:0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.429814:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787781884.429832:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962974720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781884.429912:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962974720:12345-0@lo:400:kworker.0 Request processed in 86us (3140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781884.429920:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787781884.430260:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6ed00 x1874624962974720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781884.430275:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962974720:0@lo:400:kworker.0 00000100:00100000:3.0:1787781884.431945:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787781884.934696:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781884.934718:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962975104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781884.934785:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781884.934849:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975104 00000100:00100000:3.0:1787781884.934856:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975104 00000100:00100000:3.0:1787781884.934902:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787781884.934911:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962975104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781884.934941:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781884.934981:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962975104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781884.934987:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787781884.935023:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c780 x1874624962975104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781884.935040:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962975104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781884.935737:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962975232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781884.935771:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781884.935918:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975232 00000100:00100000:1.0:1787781884.935923:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975232 00000100:00100000:1.0:1787781884.935962:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787781884.935969:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962975232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787781884.935982:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781884.936018:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962975232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781884.936025:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787781884.936053:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6e580 x1874624962975232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781884.936067:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962975232:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787781884.997789:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781885.447666:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962975360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781885.447734:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781885.447800:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975360 00000100:00100000:3.0:1787781885.447808:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975360 00000100:00100000:3.0:1787781885.447850:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787781885.447858:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962975360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781885.447913:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781885.447962:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962975360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781885.447970:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787781885.448010:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a7c00 x1874624962975360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781885.448025:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962975360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781885.448337:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781885.448357:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962975488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781885.448390:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781885.448419:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975488 00000100:00100000:2.0:1787781885.448423:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975488 00000100:00100000:2.0:1787781885.448450:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787781885.448457:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962975488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781885.448469:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781885.448519:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962975488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781885.448526:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787781885.448559:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4f00 x1874624962975488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781885.448573:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962975488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781886.021774:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781886.855833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781886.855883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781886.855912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781886.855979:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975616 00000100:00100000:3.0:1787781886.855990:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975616 00000100:00100000:3.0:1787781886.856053:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975744 00000100:00100000:3.0:1787781886.856056:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975744 00000100:00100000:3.0:1787781886.856094:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:3.0:1787781886.856105:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942975616:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781886.856173:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624942975616:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 70us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781886.856181:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:3.0:1787781886.856197:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00100000:3.0:1787781886.856204:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942975744:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781886.856231:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942975744:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781886.856237:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00080000:1.0:1787781886.856758:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781886.856765:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781886.856826:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975488 00000100:00100000:0.0:1787781886.856833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975488 00000100:00100000:0.0:1787781886.856886:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 289 00000100:00100000:0.0:1787781886.856894:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2406:x1874624942975488:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781886.856945:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2406:x1874624942975488:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 53us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781886.856953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 289 00010000:00010000:3.0:1787781887.046778:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781887.495274:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962975616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781887.495417:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781887.495581:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975616 00000100:00100000:3.0:1787781887.495590:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975616 00000100:00100000:3.0:1787781887.495678:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787781887.495703:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962975616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781887.495750:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781887.505631:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962975616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9921us (10205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781887.505688:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962975616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781887.505761:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1787781888.071524:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781889.094749:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781889.542573:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962975744:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542693:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542767:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962976256:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542798:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542820:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962976768:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542846:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542865:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962977280:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542886:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542912:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787781889.542919:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962975872:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542943:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542960:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962976384:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.542981:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.542998:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962976896:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543018:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543052:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962976000:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543076:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543095:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962976512:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543128:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543156:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962977024:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543178:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543192:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787781889.543198:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962976128:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543218:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543228:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962976640:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543248:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543264:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962977152:0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543282:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781889.543317:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975744 00000100:00100000:3.0:1787781889.543327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975744 00000100:00100000:3.0:1787781889.543387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787781889.543398:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.543455:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962975744:12345-0@lo:400:kworker.0 Request processed in 59us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.543463:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787781889.543512:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976256 00000100:00100000:3.0:1787781889.543517:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976256 00000100:00100000:3.0:1787781889.543541:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976000 00000100:00100000:3.0:1787781889.543544:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976000 00000100:00100000:3.0:1787781889.543559:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787781889.543565:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962976256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.544394:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962976256:12345-0@lo:400:kworker.0 Request processed in 822us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.544403:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787781889.544430:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787781889.544440:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962976000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.544513:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962976000:12345-0@lo:400:kworker.0 Request processed in 76us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.544520:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787781889.544546:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976768 00000100:00100000:3.0:1787781889.544551:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976768 00000100:00100000:3.0:1787781889.544590:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977280 00000100:00100000:3.0:1787781889.544593:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977280 00000100:00100000:3.0:1787781889.544620:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976640 00000100:00100000:3.0:1787781889.544624:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976640 00000100:00100000:3.0:1787781889.544640:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977152 00000100:00100000:3.0:1787781889.544643:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977152 00000100:00100000:3.0:1787781889.544659:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787781889.544665:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962976768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.544700:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962976768:12345-0@lo:400:kworker.0 Request processed in 35us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.544706:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787781889.546113:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962977408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781889.546201:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781889.546266:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977408 00000100:00100000:2.0:1787781889.546273:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977408 00000100:00100000:2.0:1787781889.546311:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787781889.546319:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d80a1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962977408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781889.546359:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781889.546409:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d80a1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962977408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.546416:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787781889.546827:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781889.546842:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962977280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.546886:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962977280:12345-0@lo:400:kworker.0 Request processed in 50us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.546892:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781889.546909:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787781889.546916:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962976640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.546944:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962976640:12345-0@lo:400:kworker.0 Request processed in 30us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.546949:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787781889.546960:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787781889.546977:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.547003:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962977152:12345-0@lo:400:kworker.0 Request processed in 27us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.547009:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787781889.547039:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962975872 00000100:00100000:3.0:1787781889.547044:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962975872 00000100:00100000:3.0:1787781889.547066:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976384 00000100:00100000:3.0:1787781889.547068:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976384 00000100:00100000:3.0:1787781889.547085:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976896 00000100:00100000:2.0:1787781889.547085:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962977408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781889.547087:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976896 00000100:00100000:3.0:1787781889.547098:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976512 00000100:00100000:2.0:1787781889.547299:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977024 00000100:00100000:2.0:1787781889.547304:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977024 00000100:00100000:2.0:1787781889.547323:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962976128 00000100:00100000:2.0:1787781889.547326:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976128 00000100:00100000:2.0:1787781889.547339:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787781889.547345:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962975872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.547380:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962975872:12345-0@lo:400:kworker.0 Request processed in 35us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.547387:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787781889.547408:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787781889.547414:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962976384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.547445:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962976384:12345-0@lo:400:kworker.0 Request processed in 32us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.547450:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787781889.547460:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781889.547466:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962976896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.547508:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962976896:12345-0@lo:400:kworker.0 Request processed in 42us (4489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.547513:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781889.547525:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787781889.547531:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.547558:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962977024:12345-0@lo:400:kworker.0 Request processed in 27us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.547563:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787781889.548105:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787781889.548116:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962976128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.548158:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962976128:12345-0@lo:400:kworker.0 Request processed in 46us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781889.548165:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787781889.548178:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962976512 00000100:00100000:3.0:1787781889.548216:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781889.548224:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962976512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781889.548259:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962976512:12345-0@lo:400:kworker.0 Request processed in 36us (5130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781889.548265:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787781889.548283:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781889.548287:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781889.548731:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781889.548734:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781889.548791:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962976128:0@lo:400:kworker.0 00010000:00080000:2.0:1787781889.548811:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1f0c0 x1874624962976640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781889.548824:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962976640:0@lo:400:kworker.0 00010000:00080000:2.0:1787781889.548846:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c830c0 x1874624962977152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781889.548855:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962977152:0@lo:400:kworker.0 00000100:00100000:2.0:1787781889.548866:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962976000:0@lo:400:kworker.0 00010000:00080000:2.0:1787781889.548876:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1ed00 x1874624962976512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781889.548884:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962976512:0@lo:400:kworker.0 00010000:00080000:2.0:1787781889.548896:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c80780 x1874624962977024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781889.548904:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962977024:0@lo:400:kworker.0 00000100:00100000:1.0:1787781889.549015:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962975872:0@lo:400:kworker.0 00000100:00100000:1.0:1787781889.549028:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962976384:0@lo:400:kworker.0 00000100:00100000:1.0:1787781889.549041:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962976896:0@lo:400:kworker.0 00000100:00100000:1.0:1787781889.549054:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962975744:0@lo:400:kworker.0 00000100:00100000:1.0:1787781889.549067:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962976256:0@lo:400:kworker.0 00010000:00080000:1.0:1787781889.549091:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1c780 x1874624962976768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781889.549101:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962976768:0@lo:400:kworker.0 00010000:00080000:1.0:1787781889.549113:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c80f00 x1874624962977280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781889.549121:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962977280:0@lo:400:kworker.0 00000001:02000400:0.0:1787781889.651428:0:12006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:04:47 (1787781887) === 00000100:00100000:3.0:1787781890.053938:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781890.053961:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962977536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781890.054031:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781890.054440:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781890.054452:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781890.055979:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781890.062349:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977536 00000100:00100000:1.0:1787781890.062362:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977536 00000100:00100000:1.0:1787781890.062479:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977664 00000100:00100000:1.0:1787781890.062492:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977664 00000100:00100000:0.0:1787781890.062784:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781890.062796:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962977536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781890.062826:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781890.062920:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962977536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (8888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.062944:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781890.062961:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781890.062968:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962977664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781890.062979:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781890.063015:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962977664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (7041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.063022:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787781890.063100:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6da40 x1874624962977536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781890.063119:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962977536:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787781890.066104:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43dd6d00 x1874624962977664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781890.066133:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781890.087771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.087986:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942975872 00000100:00100000:2.0:1787781890.087997:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942975872 00000100:00100000:2.0:1787781890.088055:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 291 00000100:00100000:2.0:1787781890.088066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:8762:x1874624942975872:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787781890.088082:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781890.088098:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150fa00/0xc6d6745c1506341b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838c1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.088125:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150fa00/0xc6d6745c1506341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838c1 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.088158:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150fa00/0xc6d6745c1506341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838c1 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.088166:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150fa00, rc 0) 00000100:00100000:2.0:1787781890.088236:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942975872:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 172us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.088244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 291 00000100:00100000:3.0:1787781890.102128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.106225:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976000 00000100:00100000:1.0:1787781890.106238:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976000 00000100:00100000:0.0:1787781890.107664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 292 00000100:00100000:0.0:1787781890.107684:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942976000:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787781890.107981:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942976000:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 304us (5860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.107989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 292 00000100:00100000:0.0:1787781890.116426:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.116580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976128 00000100:00100000:2.0:1787781890.116588:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976128 00000100:00100000:2.0:1787781890.116677:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 293 00000100:00100000:2.0:1787781890.116687:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942976128:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787781890.116829:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942976128:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 142us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.116837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 293 00010000:00010000:1.0:1787781890.117902:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781890.123773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781890.124006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976256 00000100:00100000:0.0:1787781890.124016:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976256 00000100:00100000:0.0:1787781890.124095:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 294 00000100:00100000:0.0:1787781890.124105:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976256:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781890.124272:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976256:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 168us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.124280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 294 00000100:00100000:0.0:1787781890.164465:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.164583:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976384 00000100:00100000:3.0:1787781890.164597:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976384 00000100:00100000:3.0:1787781890.164679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 295 00000100:00100000:3.0:1787781890.164690:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976384:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781890.164863:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976384:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 173us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.164871:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 295 00000100:00100000:3.0:1787781890.177708:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.179713:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976512 00000100:00100000:2.0:1787781890.179727:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976512 00000100:00100000:2.0:1787781890.179780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 296 00000100:00100000:2.0:1787781890.179790:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976512:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787781890.179971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8766:x1874624942976512:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 182us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.179979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 296 00000100:00100000:1.0:1787781890.183338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781890.183425:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976640 00000100:00100000:0.0:1787781890.183435:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976640 00000100:00100000:0.0:1787781890.183498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 297 00000100:00100000:0.0:1787781890.183508:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:8762:x1874624942976640:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787781890.183540:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781890.183558:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8c00/0xc6d6745c15063422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838f2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781890.183589:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8c00/0xc6d6745c15063422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f2 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781890.183600:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8c00/0xc6d6745c15063422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f2 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781890.183636:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8c00, rc 0) 00000100:00100000:0.0:1787781890.183699:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:8762:x1874624942976640:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 192us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.183706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 297 00000100:00100000:0.0:1787781890.195787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.195889:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976768 00000100:00100000:3.0:1787781890.195898:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976768 00000100:00100000:3.0:1787781890.195952:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 298 00000100:00100000:3.0:1787781890.195962:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:8762:x1874624942976768:12345-192.168.206.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787781890.195988:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787781890.196013:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787781890.196017:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787781890.196020:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787781890.196023:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787781890.196026:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787781890.205823:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:8762:x1874624942976768:12345-192.168.206.16@tcp:256:mount.lustre.0 Request processed in 9852us (10037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.205838:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 298 00000100:00100000:1.0:1787781890.210353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.210636:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942976896 00000100:00100000:2.0:1787781890.210655:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942976896 00000100:00100000:2.0:1787781890.210711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 299 00000100:00100000:2.0:1787781890.210721:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:8762:x1874624942976896:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787781890.210755:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781890.210774:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb838f9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.210802:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.210812:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781890.210821:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e200, rc 0) 00000100:00100000:2.0:1787781890.210882:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8762:x1874624942976896:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 163us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.210890:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 299 00000100:00100000:0.0:1787781890.213150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.213226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977024 00000100:00100000:3.0:1787781890.213235:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977024 00000100:00100000:3.0:1787781890.213284:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 300 00000100:00100000:3.0:1787781890.213292:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8762:x1874624942977024:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787781890.213422:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8762:x1874624942977024:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.213448:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 300 00000100:00100000:3.0:1787781890.215301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781890.215388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977152 00000100:00100000:0.0:1787781890.215396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977152 00000100:00100000:0.0:1787781890.215441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 301 00000100:00100000:0.0:1787781890.215449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8762:x1874624942977152:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787781890.215595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8762:x1874624942977152:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.215603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 301 00000100:00100000:1.0:1787781890.229740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.230055:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977280 00000100:00100000:2.0:1787781890.230065:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977280 00000100:00100000:2.0:1787781890.230108:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 302 00000100:00100000:2.0:1787781890.230116:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8771:x1874624942977280:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787781890.230264:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8771:x1874624942977280:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 147us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.230272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 302 00000100:00100000:1.0:1787781890.235002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.235135:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977408 00000100:00100000:3.0:1787781890.235145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977408 00000100:00100000:3.0:1787781890.235200:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 303 00000100:00100000:3.0:1787781890.235209:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8771:x1874624942977408:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781890.235444:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:8771:x1874624942977408:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 234us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.235942:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 303 00000100:00100000:3.0:1787781890.253378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.253499:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.258001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.263654:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977536 00000100:00100000:2.0:1787781890.263669:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977536 00000100:00100000:2.0:1787781890.263734:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977792 00000100:00100000:2.0:1787781890.263737:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977792 00000100:00100000:2.0:1787781890.263774:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:2.0:1787781890.263783:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1874624942977536:12345-192.168.206.16@tcp:38:mount.lustre.0 00000100:00100000:1.0:1787781890.263783:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787781890.263788:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1874624942977792:12345-192.168.206.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787781890.263820:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7bc9a1c7-2800-4790-98ed-a61ff9e58135@192.168.206.16@tcp t0 exp 0000000000000000 cur 327 last 0 00010000:00080000:2.0:1787781890.263829:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7bc9a1c7-2800-4790-98ed-a61ff9e58135@192.168.206.16@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1787781890.263858:0:6533:0:(genops.c:1385:class_connect()) connect: client 7bc9a1c7-2800-4790-98ed-a61ff9e58135, cookie 0xc6d6745c15063437 00000020:00000080:1.0:1787781890.263858:0:6531:0:(genops.c:1385:class_connect()) connect: client 7bc9a1c7-2800-4790-98ed-a61ff9e58135, cookie 0xc6d6745c15063430 00000004:00100000:2.0:1787781890.264234:0:6533:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787781890.264368:0:6533:0:(import.c:65:import_set_state_nolock()) ffff993c437f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787781890.264442:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2405:x1874624942977536:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 658us (11084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.264451:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:3.0:1787781890.264874:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.265066:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978176 00000100:00100000:2.0:1787781890.265074:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978176 00000100:00100000:2.0:1787781890.265119:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978304 00000100:00100000:2.0:1787781890.265122:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978304 00000100:00100000:2.0:1787781890.265140:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:2.0:1787781890.265148:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942978176:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781890.265191:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942978176:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 44us (7199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.265198:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:2.0:1787781890.265212:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:2.0:1787781890.265217:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942978304:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781890.265241:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942978304:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.265246:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00080000:3.0:1787781890.269008:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781890.269017:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781890.269587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.269644:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781890.269668:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978048 00000100:00100000:2.0:1787781890.269676:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978048 00000100:00100000:2.0:1787781890.269944:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977664 00000100:00100000:2.0:1787781890.269948:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977664 00000100:00100000:2.0:1787781890.269967:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:2.0:1787781890.269975:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+7:8762:x1874624942978048:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787781890.270012:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:3.0:1787781890.270131:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:1.0:1787781890.271200:0:6531:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787781890.271328:0:6531:0:(import.c:65:import_set_state_nolock()) ffff993d67f86800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787781890.271367:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+7:8762:x1874624942978048:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 1390us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.271378:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:2.0:1787781890.271406:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787781890.271415:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:0:x1874624942977664:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787781890.271434:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787781890.271494:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2405:x1874624942977792:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 7693us (17986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781890.271502:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:2.0:1787781890.275158:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:0:x1874624942977664:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 3731us (5499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.275171:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787781890.278426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.278512:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978432 00000100:00100000:3.0:1787781890.278521:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978432 00000100:00100000:3.0:1787781890.278573:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:3.0:1787781890.278580:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942978432:12345-192.168.206.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787781890.278695:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942978432:12345-192.168.206.16@tcp:40:mount.lustre.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.278702:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:3.0:1787781890.282598:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.282675:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781890.282760:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978560 00000100:00100000:0.0:1787781890.282769:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978560 00000100:00100000:0.0:1787781890.282813:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978688 00000100:00100000:0.0:1787781890.282816:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978688 00000100:00100000:0.0:1787781890.282860:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:0.0:1787781890.282867:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1874624942978560:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787781890.282900:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7bc9a1c7-2800-4790-98ed-a61ff9e58135@192.168.206.16@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:0.0:1787781890.282933:0:8445:0:(genops.c:1385:class_connect()) connect: client 7bc9a1c7-2800-4790-98ed-a61ff9e58135, cookie 0xc6d6745c1506343e 00002000:00100000:0.0:1787781890.282945:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bc9a1c7-2800-4790-98ed-a61ff9e58135/ffff993d67f91000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781890.282960:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787781890.282993:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:2.0:1787781890.282999:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1874624942978688:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787781890.283016:0:8638:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7bc9a1c7-2800-4790-98ed-a61ff9e58135@192.168.206.16@tcp t0 exp 0000000000000000 cur 327 last 0 00002000:00080000:0.0:1787781890.283030:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1787781890.283032:0:8638:0:(genops.c:1385:class_connect()) connect: client 7bc9a1c7-2800-4790-98ed-a61ff9e58135, cookie 0xc6d6745c15063445 00002000:00100000:2.0:1787781890.283037:0:8638:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bc9a1c7-2800-4790-98ed-a61ff9e58135/ffff993c437f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787781890.283044:0:8638:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787781890.283070:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993d67f91800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1787781890.283083:0:8638:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787781890.283095:0:8638:0:(import.c:65:import_set_state_nolock()) ffff993c437f6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781890.283232:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2405:x1874624942978560:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 363us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.283242:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:2.0:1787781890.285232:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2405:x1874624942978688:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 2220us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.285262:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:1.0:1787781890.286309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781890.286677:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942977920 00000100:00100000:1.0:1787781890.286685:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942977920 00000100:00100000:1.0:1787781890.286729:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979072 00000100:00100000:1.0:1787781890.286733:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979072 00000100:00100000:1.0:1787781890.286746:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979328 00000100:00100000:1.0:1787781890.286748:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979328 00000100:00100000:1.0:1787781890.286757:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979200 00000100:00100000:1.0:1787781890.286759:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979200 00000100:00100000:1.0:1787781890.286773:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:1.0:1787781890.286780:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942979072:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781890.286843:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942979072:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 64us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781890.286850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:1.0:1787781890.286865:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:2.0:1787781890.286870:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 141 00000100:00100000:1.0:1787781890.286871:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+7:2406:x1874624942979328:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781890.286889:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942979200:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781890.286911:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+7:2406:x1874624942979328:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 41us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.286912:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942979200:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781890.286918:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:3.0:1787781890.287223:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978816 00000100:00100000:3.0:1787781890.287235:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978816 00000100:00100000:3.0:1787781890.287267:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:3.0:1787781890.287275:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942978816:12345-192.168.206.16@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787781890.287312:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942978816:12345-192.168.206.16@tcp:900:mount.lustre.0 Request processed in 38us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.287319:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:2.0:1787781890.289575:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 141 00000100:00100000:0.0:1787781890.289588:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:0.0:1787781890.289622:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:0:x1874624942977920:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787781890.289661:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781890.289737:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:0:x1874624942977920:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 140us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.289745:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:0.0:1787781890.289770:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942978944 00000100:00100000:0.0:1787781890.289777:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942978944 00000100:00100000:0.0:1787781890.291814:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 304 00000100:00100000:0.0:1787781890.291832:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624942978944:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781890.291904:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624942978944:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 79us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.291912:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 304 00000100:00080000:1.0:1787781890.292016:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781890.292359:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781890.292522:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979456 00000100:00100000:3.0:1787781890.292530:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979456 00000100:00100000:3.0:1787781890.292577:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:3.0:1787781890.292585:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942979456:12345-192.168.206.16@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787781890.292687:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787781890.292743:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:8762:x1874624942979456:12345-192.168.206.16@tcp:33:mount.lustre.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.292751:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:1.0:1787781890.566576:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962977792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781890.566678:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781890.567448:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977792 00000100:00100000:2.0:1787781890.567456:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977792 00000100:00100000:2.0:1787781890.567529:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787781890.567540:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962977792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787781890.567563:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781890.567640:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962977792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.567647:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787781890.567782:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a6d00 x1874624962977792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781890.567800:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962977792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781890.568140:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962977920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781890.568268:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781890.570022:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962977920 00000100:00100000:2.0:1787781890.570034:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962977920 00000100:00100000:2.0:1787781890.570090:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781890.570099:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962977920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781890.570126:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781890.571132:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962977920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1030us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.571142:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787781890.574315:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ec3c0 x1874624962977920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781890.574415:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962977920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781891.141828:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781892.166008:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781892.614566:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962978048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781892.614708:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781892.614828:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978048 00000100:00100000:0.0:1787781892.614837:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978048 00000100:00100000:0.0:1787781892.614902:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787781892.614912:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962978048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781892.614945:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781892.614994:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962978048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781892.615002:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787781892.615193:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962978048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781893.191778:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781894.215049:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781894.662012:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781894.662047:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962978176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781894.662787:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962978432:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.662905:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.662977:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962978944:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.663003:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.663037:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962979456:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.663062:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.663084:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787781894.663091:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962978304:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.663124:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.663149:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962978816:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.663199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.663216:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962979328:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664517:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.664573:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962979840:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664638:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.664682:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962978688:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.664732:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962979200:0@lo:400:kworker.0 00000100:00100000:0.0:1787781894.664767:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.664768:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781894.664802:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962979712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781894.664812:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962978560:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664827:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781894.664846:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781894.664866:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962979072:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664870:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978304 00000100:00100000:3.0:1787781894.664881:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978304 00000100:00100000:0.0:1787781894.664890:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781894.664904:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962979584:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.664937:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787781894.664948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962978304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.665434:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978432 00000100:00100000:1.0:1787781894.665442:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978432 00000100:00100000:1.0:1787781894.665481:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978944 00000100:00100000:1.0:1787781894.665486:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978944 00000100:00100000:1.0:1787781894.665511:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979456 00000100:00100000:1.0:1787781894.665514:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979456 00000100:00100000:1.0:1787781894.665528:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978688 00000100:00100000:1.0:1787781894.665530:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978688 00000100:00100000:1.0:1787781894.665541:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979072 00000100:00100000:1.0:1787781894.665544:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979072 00000100:00100000:1.0:1787781894.665575:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781894.665583:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781894.665811:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787781894.665823:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962978944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.669739:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962978432:12345-0@lo:400:kworker.0 Request processed in 4140us (6817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781894.669777:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781894.669822:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787781894.669836:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962979456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.669901:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624962979456:12345-0@lo:400:kworker.0 Request processed in 71us (6837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781894.669908:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787781894.669922:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787781894.669928:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962978688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.669979:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962978688:12345-0@lo:400:kworker.0 Request processed in 52us (5267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781894.669986:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787781894.669999:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787781894.670006:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962979072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.670039:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962979072:12345-0@lo:400:kworker.0 Request processed in 34us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781894.670044:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787781894.670077:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979328 00000100:00100000:1.0:1787781894.670086:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979328 00000100:00100000:3.0:1787781894.671650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962978304:12345-0@lo:400:kworker.0 Request processed in 6690us (8511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.671667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787781894.671748:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979840 00000100:00100000:3.0:1787781894.671758:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979840 00000100:00100000:3.0:1787781894.671817:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979200 00000100:00100000:3.0:1787781894.671821:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979200 00000100:00100000:3.0:1787781894.671841:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979712 00000100:00100000:3.0:1787781894.671844:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979712 00000100:00100000:3.0:1787781894.671859:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787781894.671868:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962979840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.671970:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962979840:12345-0@lo:400:kworker.0 Request processed in 103us (7331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.671977:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787781894.671990:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781894.671997:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962979200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672028:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962979200:12345-0@lo:400:kworker.0 Request processed in 32us (7263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.672034:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781894.672045:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781894.672051:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962979712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672081:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962979712:12345-0@lo:400:kworker.0 Request processed in 30us (7254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.672087:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781894.672138:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962978304:0@lo:400:kworker.0 00010000:00080000:3.0:1787781894.672159:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f64780 x1874624962979840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781894.672172:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962979840:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672188:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962978432:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672203:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624962979456:0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672276:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978816 00000100:00100000:3.0:1787781894.672280:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978816 00000100:00100000:3.0:1787781894.672305:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978176 00000100:00100000:3.0:1787781894.672308:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978176 00000100:00100000:3.0:1787781894.672320:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962978560 00000100:00100000:3.0:1787781894.672330:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962978560 00000100:00100000:3.0:1787781894.672345:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787781894.672351:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962978816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672423:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962978816:12345-0@lo:400:kworker.0 Request processed in 72us (9224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.672429:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787781894.672440:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787781894.672446:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624962978176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781894.672487:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787781894.672544:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624962978176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (7781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.672551:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787781894.672562:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787781894.672569:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962978560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781894.672598:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962978560:12345-0@lo:400:kworker.0 Request processed in 30us (7753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.672604:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787781894.672672:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962978816:0@lo:400:kworker.0 00000100:00080000:3.0:1787781894.672882:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781894.672887:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787781894.672892:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781894.672895:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781894.672928:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962978688:0@lo:400:kworker.0 00010000:00080000:3.0:1787781894.672945:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fda940 x1874624962979200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781894.672957:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962979200:0@lo:400:kworker.0 00010000:00080000:3.0:1787781894.672986:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b70c0 x1874624962979712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781894.672994:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962979712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781894.673278:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781894.673422:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962978944:12345-0@lo:400:kworker.0 Request processed in 7599us (10415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781894.673513:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787781894.673554:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962978944:0@lo:400:kworker.0 00000100:00100000:2.0:1787781894.673575:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979584 00000100:00100000:2.0:1787781894.673582:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979584 00000100:00080000:2.0:1787781894.674006:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781894.674058:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962978176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781894.674062:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787781894.674074:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962979584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781894.674111:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962978560:0@lo:400:kworker.0 00000100:00100000:2.0:1787781894.674157:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962979584:12345-0@lo:400:kworker.0 Request processed in 74us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781894.674164:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00080000:0.0:1787781894.674194:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd9e00 x1874624962979072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781894.674205:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962979072:0@lo:400:kworker.0 00010000:00080000:0.0:1787781894.674220:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b4000 x1874624962979584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781894.674228:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962979584:0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.679377:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787781894.679410:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781894.679553:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962979328:12345-0@lo:400:kworker.0 Request processed in 161us (15042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781894.679562:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1787781894.679787:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fda1c0 x1874624962979328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781894.679806:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962979328:0@lo:400:kworker.0 00000100:00100000:1.0:1787781895.176177:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781895.176198:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962979968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781895.176497:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781895.176602:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962979968 00000100:00100000:3.0:1787781895.176645:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962979968 00000100:00100000:3.0:1787781895.176710:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787781895.176723:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962979968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781895.176754:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781895.176823:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962979968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781895.176831:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1787781895.177326:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6ed00 x1874624962979968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781895.177346:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962979968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781895.180437:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781895.180523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781895.180631:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980096 00000100:00100000:3.0:1787781895.180639:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980096 00000100:00100000:3.0:1787781895.180687:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787781895.180697:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962980096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781895.180718:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781895.192228:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962980096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11524us (11696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781895.192243:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787781895.193155:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43dd4780 x1874624962980096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781895.193180:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962980096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781895.238826:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781895.570394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570475:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781895.570680:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980352 00000100:00100000:1.0:1787781895.570692:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980352 00000100:00100000:1.0:1787781895.570759:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980224 00000100:00100000:1.0:1787781895.570762:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980224 00000100:00100000:1.0:1787781895.570789:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:1.0:1787781895.570800:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980352:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.570885:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980352:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 87us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.570894:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:1.0:1787781895.570912:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:1.0:1787781895.570919:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980224:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.570945:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980224:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.570967:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:1.0:1787781895.570987:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979840 00000100:00100000:1.0:1787781895.570991:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979840 00000100:00100000:1.0:1787781895.571012:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980096 00000100:00100000:1.0:1787781895.571015:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980096 00000100:00100000:1.0:1787781895.571026:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979712 00000100:00100000:1.0:1787781895.571029:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979712 00000100:00100000:1.0:1787781895.571042:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979968 00000100:00100000:1.0:1787781895.571044:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979968 00000100:00100000:1.0:1787781895.571059:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 148 00000100:00100000:1.0:1787781895.571065:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942979840:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.571096:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942979840:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.571104:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 148 00000100:00100000:1.0:1787781895.571116:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 149 00000100:00100000:1.0:1787781895.571122:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980096:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.571160:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942980096:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 38us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.571167:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 149 00000100:00100000:1.0:1787781895.571178:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:1.0:1787781895.571185:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942979712:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.571211:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942979712:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.571218:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:1.0:1787781895.571230:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00100000:1.0:1787781895.571245:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942979968:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781895.571273:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624942979968:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781895.571279:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00080000:2.0:1787781895.571899:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781895.571905:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781895.571908:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781895.571911:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781895.572696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942979584 00000100:00100000:0.0:1787781895.572719:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942979584 00000100:00100000:0.0:1787781895.572786:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 306 00000100:00100000:0.0:1787781895.572794:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942979584:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781895.572870:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942979584:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 77us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.572877:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 306 00000100:00100000:2.0:1787781895.686561:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781895.686592:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962980224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781895.686771:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781895.688314:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980224 00000100:00100000:2.0:1787781895.688330:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980224 00000100:00100000:2.0:1787781895.688403:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781895.688415:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962980224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787781895.688467:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781895.688572:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962980224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781895.688580:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787781895.688650:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a7840 x1874624962980224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781895.688673:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962980224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781895.689587:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781895.689632:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962980352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781895.689699:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781895.689756:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980352 00000100:00100000:3.0:1787781895.689763:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980352 00000100:00100000:3.0:1787781895.689802:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781895.689811:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962980352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781895.689840:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781895.689885:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962980352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781895.689892:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787781895.689945:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa1c0 x1874624962980352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781895.689963:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962980352:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787781895.696873:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00100000:1.0:1787781895.698320:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00100000:3.0:1787781895.699533:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00100000:2.0:1787781895.705041:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:02000400:3.0:1787781895.975783:0:12199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787781896.263754:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781897.297154:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781897.734027:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781897.734056:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962980480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781897.734149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781897.734235:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980480 00000100:00100000:1.0:1787781897.734243:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980480 00000100:00100000:1.0:1787781897.734301:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787781897.734312:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962980480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781897.734352:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781897.734420:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962980480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781897.734428:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787781897.734493:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962980480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781898.310890:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781899.334101:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781899.784665:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962980608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781899.784765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.784878:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980608 00000100:00100000:3.0:1787781899.784888:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980608 00000100:00100000:3.0:1787781899.784946:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787781899.784956:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962980608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781899.785007:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787781899.785060:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962980608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.785068:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787781899.785119:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962980608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781899.785591:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962980864:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785656:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785693:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962981376:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785718:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785743:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962981888:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785763:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785786:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787781899.785793:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962980992:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785814:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785848:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962981504:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785875:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785897:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962982016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.785921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781899.785948:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980864 00000100:00100000:1.0:1787781899.785953:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980864 00000100:00100000:1.0:1787781899.785993:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981376 00000100:00100000:1.0:1787781899.785997:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981376 00000100:00100000:1.0:1787781899.786022:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981888 00000100:00100000:1.0:1787781899.786024:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981888 00000100:00100000:1.0:1787781899.786036:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980992 00000100:00100000:1.0:1787781899.786038:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980992 00000100:00100000:1.0:1787781899.786049:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787781899.786056:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962980864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786103:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962980864:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786111:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787781899.786128:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787781899.786134:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786163:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962981376:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786176:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787781899.786188:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787781899.786193:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962981888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786223:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962981888:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786229:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787781899.786240:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787781899.786246:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962980992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786479:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962980992:12345-0@lo:400:kworker.0 Request processed in 232us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786485:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787781899.786538:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981504 00000100:00100000:1.0:1787781899.786542:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981504 00000100:00100000:1.0:1787781899.786578:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982016 00000100:00100000:1.0:1787781899.786582:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982016 00000100:00100000:1.0:1787781899.786635:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781899.786643:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962981504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786674:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962981504:12345-0@lo:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786681:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781899.786692:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787781899.786698:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962982016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.786725:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962982016:12345-0@lo:400:kworker.0 Request processed in 27us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.786730:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787781899.786761:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781899.786765:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781899.786768:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781899.786801:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962980992:0@lo:400:kworker.0 00010000:00080000:1.0:1787781899.786815:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41cd83c0 x1874624962981504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781899.787184:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962981504:0@lo:400:kworker.0 00010000:00080000:1.0:1787781899.787200:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c426930c0 x1874624962982016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781899.787209:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962982016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.787223:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962980864:0@lo:400:kworker.0 00010000:00080000:1.0:1787781899.787234:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd5e00 x1874624962981376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781899.787242:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962981376:0@lo:400:kworker.0 00010000:00080000:1.0:1787781899.787253:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42691a40 x1874624962981888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781899.787428:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962981888:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788073:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962980736:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788170:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.788250:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962981248:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788497:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.788530:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962981760:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788579:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.788656:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787781899.788671:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962981120:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788718:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.788761:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962981632:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.788787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.788807:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962982144:0@lo:400:kworker.0 00000100:00100000:2.0:1787781899.788986:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962980736 00000100:00100000:2.0:1787781899.789001:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962980736 00000100:00100000:2.0:1787781899.789073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787781899.789090:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781899.789159:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624962980736:12345-0@lo:400:kworker.0 Request processed in 77us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.789166:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787781899.789669:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781899.789728:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962980736:0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.789793:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981120 00000100:00100000:3.0:1787781899.789798:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981120 00000100:00100000:1.0:1787781899.790466:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981248 00000100:00100000:1.0:1787781899.790472:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981248 00000100:00100000:1.0:1787781899.790530:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981760 00000100:00100000:1.0:1787781899.790533:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981760 00000100:00100000:1.0:1787781899.790557:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787781899.790565:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962981248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.790654:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962981248:12345-0@lo:400:kworker.0 Request processed in 89us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.790684:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787781899.790703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787781899.790710:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962981760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.790746:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962981760:12345-0@lo:400:kworker.0 Request processed in 37us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781899.790753:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1787781899.790776:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781899.791256:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787781899.791518:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962981632 00000100:00100000:2.0:1787781899.791525:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962981632 00000100:00100000:2.0:1787781899.791572:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982144 00000100:00100000:2.0:1787781899.791576:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982144 00000100:00100000:2.0:1787781899.791602:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787781899.791635:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962981632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781899.791692:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962981632:12345-0@lo:400:kworker.0 Request processed in 60us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.791716:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787781899.791735:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787781899.791741:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962982144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781899.791773:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962982144:12345-0@lo:400:kworker.0 Request processed in 32us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.791778:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787781899.791800:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781899.791804:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781899.791973:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bf2e940 x1874624962981632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781899.792137:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962981120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781899.792181:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962981120:12345-0@lo:400:kworker.0 Request processed in 52us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.792188:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787781899.793101:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962981632:0@lo:400:kworker.0 00010000:00080000:1.0:1787781899.793138:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42690780 x1874624962982144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781899.793150:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962982144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.793165:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962981248:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.793188:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962981760:0@lo:400:kworker.0 00000100:00100000:1.0:1787781899.793245:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962981120:0@lo:400:kworker.0 00000100:00100000:3.0:1787781900.293934:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962982272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781900.294043:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781900.294045:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.294113:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982272 00000100:00100000:0.0:1787781900.294131:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982272 00000100:00100000:0.0:1787781900.294199:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787781900.294211:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962982272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781900.294245:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781900.299560:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781900.301124:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982400 00000100:00100000:1.0:1787781900.301142:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982400 00000100:00100000:1.0:1787781900.301208:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787781900.301219:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962982400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781900.301252:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781900.301341:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962982400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.301369:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787781900.301425:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43dd6580 x1874624962982400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781900.301458:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781900.308454:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962982272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14221us (14385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.310305:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787781900.315332:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42691a40 x1874624962982272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781900.315366:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962982272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781900.359667:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781900.679988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680040:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680101:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781900.680206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980480 00000100:00100000:1.0:1787781900.680218:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980480 00000100:00100000:1.0:1787781900.680274:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 308 00000100:00100000:1.0:1787781900.680286:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942980480:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781900.680374:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942980480:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.680382:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 308 00000100:00100000:1.0:1787781900.680421:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980608 00000100:00100000:1.0:1787781900.680438:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980608 00000100:00100000:1.0:1787781900.680468:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980864 00000100:00100000:1.0:1787781900.680486:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980864 00000100:00100000:1.0:1787781900.680500:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980736 00000100:00100000:1.0:1787781900.680502:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980736 00000100:00100000:1.0:1787781900.680512:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942980992 00000100:00100000:1.0:1787781900.680514:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942980992 00000100:00100000:1.0:1787781900.680527:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 158 00000100:00100000:1.0:1787781900.680532:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942980608:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781900.680564:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624942980608:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.680571:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 158 00000100:00100000:1.0:1787781900.680580:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 159 00000100:00100000:1.0:1787781900.680585:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942980864:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781900.680653:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942980864:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.680660:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 159 00000100:00100000:1.0:1787781900.680671:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 160 00000100:00100000:1.0:1787781900.680676:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942980736:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781900.680700:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942980736:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.680705:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 160 00000100:00100000:1.0:1787781900.680713:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:1.0:1787781900.680719:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942980992:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781900.680736:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942980992:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 18us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.680742:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:2.0:1787781900.681294:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981120 00000100:00100000:2.0:1787781900.681302:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981120 00000100:00100000:2.0:1787781900.681349:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981248 00000100:00100000:2.0:1787781900.681353:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981248 00000100:00100000:2.0:1787781900.681381:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:2.0:1787781900.681389:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942981120:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781900.681450:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942981120:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 61us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781900.681456:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:2.0:1787781900.681479:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:2.0:1787781900.681487:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942981248:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781900.681510:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942981248:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781900.681515:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00080000:2.0:1787781900.681536:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781900.681549:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781900.681552:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781900.681555:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781900.806234:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962982528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781900.806352:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781900.806535:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982528 00000100:00100000:1.0:1787781900.806546:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982528 00000100:00100000:1.0:1787781900.806600:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781900.806658:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962982528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781900.806695:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781900.806722:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962982656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781900.806771:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781900.806772:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962982528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.806782:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781900.806806:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982656 00000100:00100000:1.0:1787781900.806809:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982656 00000100:00100000:1.0:1787781900.806831:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781900.806838:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962982656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787781900.806848:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781900.806884:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962982656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781900.806891:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787781900.807332:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caa940 x1874624962982656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781900.807383:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962982656:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787781900.807449:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ca9a40 x1874624962982528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781900.807465:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962982528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781901.382088:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781902.406257:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781902.853915:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962982784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781902.854204:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781902.854507:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982784 00000100:00100000:0.0:1787781902.854517:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982784 00000100:00100000:0.0:1787781902.854583:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787781902.854594:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962982784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781902.854674:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781902.856234:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962982784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1630us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781902.856250:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787781902.856694:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962982784:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781903.430070:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787781904.008887:0:12515:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787781904.009540:0:12515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787781904.461375:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781904.903304:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962982912:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903469:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962983424:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903499:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903522:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962983936:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903548:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903567:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903589:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903640:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787781904.903647:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962983040:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903674:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903692:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962983552:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903727:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903745:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962984064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903767:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903800:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962983296:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903825:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903844:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962983808:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903865:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903879:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903897:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903914:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787781904.903920:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962983168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.903941:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.903978:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962983680:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904000:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.904010:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904027:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781904.904063:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983424 00000100:00100000:0.0:1787781904.904072:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983424 00000100:00100000:2.0:1787781904.904126:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962982912 00000100:00100000:0.0:1787781904.904131:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983168 00000100:00100000:2.0:1787781904.904133:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962982912 00000100:00100000:0.0:1787781904.904136:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983168 00000100:00100000:0.0:1787781904.904165:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787781904.904177:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962983424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.904178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787781904.904191:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.904254:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962982912:12345-0@lo:400:kworker.0 Request processed in 66us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904258:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962983424:12345-0@lo:400:kworker.0 Request processed in 82us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781904.904267:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787781904.904270:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787781904.904300:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787781904.904309:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962983168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.904313:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983936 00000100:00100000:2.0:1787781904.904319:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983936 00000100:00100000:0.0:1787781904.904353:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962983168:12345-0@lo:400:kworker.0 Request processed in 46us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781904.904354:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984448 00000100:00100000:2.0:1787781904.904358:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984448 00000100:00100000:0.0:1787781904.904365:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787781904.904376:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983808 00000100:00100000:2.0:1787781904.904380:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983808 00000100:00100000:0.0:1787781904.904390:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983040 00000100:00100000:0.0:1787781904.904395:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983040 00000100:00100000:2.0:1787781904.904399:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984320 00000100:00100000:2.0:1787781904.904416:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984320 00000100:00100000:0.0:1787781904.904431:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983552 00000100:00100000:0.0:1787781904.904436:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983552 00000100:00100000:2.0:1787781904.904443:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787781904.904455:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984064 00000100:00100000:0.0:1787781904.904459:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984064 00000100:00100000:0.0:1787781904.904473:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983296 00000100:00100000:0.0:1787781904.904476:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983296 00000100:00100000:0.0:1787781904.904485:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962983680 00000100:00100000:0.0:1787781904.904488:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962983680 00000100:00100000:0.0:1787781904.904500:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984192 00000100:00100000:0.0:1787781904.904503:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984192 00000100:00100000:0.0:1787781904.904518:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787781904.904524:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962983040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904557:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962983040:12345-0@lo:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904563:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787781904.904576:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787781904.904582:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962983552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904641:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962983552:12345-0@lo:400:kworker.0 Request processed in 59us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904647:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787781904.904660:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787781904.904667:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962984064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904705:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962984064:12345-0@lo:400:kworker.0 Request processed in 39us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904711:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787781904.904722:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787781904.904727:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962983296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904754:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962983296:12345-0@lo:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904760:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787781904.904771:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787781904.904777:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962983680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904805:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962983680:12345-0@lo:400:kworker.0 Request processed in 28us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904811:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787781904.904822:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787781904.904828:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962984192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904856:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962984192:12345-0@lo:400:kworker.0 Request processed in 29us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904862:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787781904.904883:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787781904.904890:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904921:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962984448:12345-0@lo:400:kworker.0 Request processed in 31us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904927:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787781904.904941:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787781904.904948:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962983808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.904986:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962983808:12345-0@lo:400:kworker.0 Request processed in 39us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.904993:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787781904.905005:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787781904.905012:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.905040:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962984320:12345-0@lo:400:kworker.0 Request processed in 29us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.905046:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787781904.905093:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962983168:0@lo:400:kworker.0 00010000:00080000:0.0:1787781904.905109:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427552c0 x1874624962983680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781904.905122:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962983680:0@lo:400:kworker.0 00010000:00080000:0.0:1787781904.905133:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42754780 x1874624962984192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781904.905143:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787781904.905155:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962983296:0@lo:400:kworker.0 00010000:00080000:0.0:1787781904.905166:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427570c0 x1874624962983808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781904.905175:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962983808:0@lo:400:kworker.0 00010000:00080000:0.0:1787781904.905183:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427561c0 x1874624962984320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781904.905191:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962984320:0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.906013:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962983936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.906093:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962983936:12345-0@lo:400:kworker.0 Request processed in 1642us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781904.906103:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787781904.906143:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781904.906150:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781904.906153:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781904.906156:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781904.908945:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962984576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781904.909257:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781904.909494:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984576 00000100:00100000:2.0:1787781904.909505:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984576 00000100:00100000:2.0:1787781904.909564:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787781904.909574:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962984576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781904.909639:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781904.909702:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962984576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781904.909710:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787781904.909849:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962984576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781904.909888:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962983040:0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.909902:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962983552:0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.909916:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962984064:0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.909929:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962982912:0@lo:400:kworker.0 00000100:00100000:2.0:1787781904.909942:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962983424:0@lo:400:kworker.0 00010000:00080000:2.0:1787781904.909962:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42755680 x1874624962983936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781904.909975:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962983936:0@lo:400:kworker.0 00010000:00080000:2.0:1787781904.909991:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42756d00 x1874624962984448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781904.910000:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781905.413962:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781905.413993:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962984704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781905.414089:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781905.414172:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984704 00000100:00100000:0.0:1787781905.414181:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984704 00000100:00100000:0.0:1787781905.414249:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787781905.414260:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962984704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781905.414294:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781905.414348:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962984704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781905.414356:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787781905.414414:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42756d00 x1874624962984704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781905.414436:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962984704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781905.417710:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781905.417747:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962984832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781905.417836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781905.418456:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984832 00000100:00100000:0.0:1787781905.418467:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984832 00000100:00100000:0.0:1787781905.418530:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787781905.418541:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962984832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781905.418570:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781905.418647:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962984832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781905.418655:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787781905.419476:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42691a40 x1874624962984832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781905.419502:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962984832:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787781905.486582:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781905.804874:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781905.804932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781905.804971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981376 00000100:00100000:3.0:1787781905.804983:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981376 00000100:00100000:1.0:1787781905.804995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781905.805059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 310 00000100:00100000:3.0:1787781905.805074:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624942981376:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781905.805372:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624942981376:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 300us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781905.805383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 310 00000100:00100000:1.0:1787781905.810346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781905.810381:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982144 00000100:00100000:1.0:1787781905.810391:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982144 00000100:00100000:1.0:1787781905.810484:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:1.0:1787781905.810497:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942982144:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781905.810595:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942982144:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781905.810604:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00080000:1.0:1787781905.810651:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781905.810657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781905.813321:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981632 00000100:00100000:0.0:1787781905.813346:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981632 00000100:00100000:0.0:1787781905.813455:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981888 00000100:00100000:0.0:1787781905.813467:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981888 00000100:00100000:0.0:1787781905.813504:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 168 00000100:00100000:0.0:1787781905.813515:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42691a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942981632:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781905.813640:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42691a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942981632:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 127us (8707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781905.813650:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 168 00000100:00100000:0.0:1787781905.813671:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 169 00000100:00100000:0.0:1787781905.813678:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942981888:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781905.813706:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942981888:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (8711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781905.813713:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 169 00000100:00080000:0.0:1787781905.814980:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781905.815519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781905.815877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781905.815917:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982016 00000100:00100000:2.0:1787781905.815927:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982016 00000100:00100000:2.0:1787781905.815985:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:2.0:1787781905.815995:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942982016:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781905.816076:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942982016:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00080000:0.0:1787781905.816224:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781905.816253:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:3.0:1787781905.816356:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981504 00000100:00100000:3.0:1787781905.816362:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981504 00000100:00100000:3.0:1787781905.816483:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942981760 00000100:00100000:3.0:1787781905.816487:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942981760 00000100:00080000:2.0:1787781905.816519:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781905.816764:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 170 00000100:00100000:3.0:1787781905.816773:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942981504:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781905.816935:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942981504:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 163us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781905.816942:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 170 00000100:00100000:3.0:1787781905.816956:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 171 00000100:00100000:3.0:1787781905.816963:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942981760:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781905.816988:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942981760:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781905.817003:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 171 00000020:00000004:0.0:1787781905.897942:0:12613:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781905.898380:0:12613:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787781905.925946:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781905.925999:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962984960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781905.926100:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781905.926214:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962984960 00000100:00100000:1.0:1787781905.926225:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962984960 00000100:00100000:1.0:1787781905.926293:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787781905.926308:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962984960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787781905.926350:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781905.926444:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962984960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781905.926453:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787781905.926513:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43caad00 x1874624962984960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781905.926537:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43caad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962984960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781905.934950:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781905.934990:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42756940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962985088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781905.935099:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781905.935190:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985088 00000100:00100000:2.0:1787781905.935202:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985088 00000100:00100000:2.0:1787781905.935265:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787781905.935278:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962985088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781905.935312:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781905.935378:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962985088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781905.935388:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787781905.942239:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42756940 x1874624962985088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781905.942274:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42756940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962985088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781906.505935:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781907.525898:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781907.976048:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962985216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781907.976147:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781907.976257:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985216 00000100:00100000:0.0:1787781907.976266:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985216 00000100:00100000:0.0:1787781907.976325:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787781907.976334:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962985216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781907.976372:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781907.976529:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962985216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781907.976538:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787781907.977123:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962985216:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1787781908.015854:0:12710:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781908.016131:0:12710:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787781908.549787:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781909.574040:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781910.021898:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781910.021929:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962985344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781910.022019:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781910.022096:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985344 00000100:00100000:2.0:1787781910.022109:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985344 00000100:00100000:2.0:1787781910.022156:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787781910.022164:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962985344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781910.022205:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781910.022256:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962985344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781910.022263:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787781910.022310:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962985344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781910.023711:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962985856:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.023776:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.023816:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962986368:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.023839:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.023858:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962986880:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.023883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.023909:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787781910.023915:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962985728:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.023943:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.023959:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962986240:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.023979:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.024000:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962986752:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024023:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.024051:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985856 00000100:00100000:1.0:1787781910.024058:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985856 00000100:00100000:1.0:1787781910.024100:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787781910.024107:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962985856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024159:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962985856:12345-0@lo:400:kworker.0 Request processed in 52us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.024165:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787781910.024185:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986368 00000100:00100000:1.0:1787781910.024188:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986368 00000100:00100000:1.0:1787781910.024233:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986880 00000100:00100000:1.0:1787781910.024237:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986880 00000100:00100000:1.0:1787781910.024251:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986240 00000100:00100000:1.0:1787781910.024254:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986240 00000100:00100000:1.0:1787781910.024267:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986752 00000100:00100000:1.0:1787781910.024269:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986752 00000100:00100000:1.0:1787781910.024280:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787781910.024286:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962986368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024314:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962986368:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.024319:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787781910.024329:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787781910.024333:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024353:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962986880:12345-0@lo:400:kworker.0 Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.024358:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787781910.024366:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787781910.024370:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962986240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024407:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962986240:12345-0@lo:400:kworker.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.024412:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787781910.024421:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787781910.024426:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024445:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962986752:12345-0@lo:400:kworker.0 Request processed in 19us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.024449:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787781910.024472:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781910.024480:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781910.024515:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd43c0 x1874624962986240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.024529:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962986240:0@lo:400:kworker.0 00010000:00080000:1.0:1787781910.024537:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd5e00 x1874624962986752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.024544:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962986752:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.024552:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962985856:0@lo:400:kworker.0 00010000:00080000:1.0:1787781910.024559:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd70c0 x1874624962986368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.024566:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962986368:0@lo:400:kworker.0 00010000:00080000:1.0:1787781910.024574:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd5a40 x1874624962986880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.024581:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962986880:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024736:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962985472:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024773:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024797:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962985984:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024817:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024834:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962986496:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024851:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024868:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787781910.024873:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962985600:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024889:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024901:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962986112:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024916:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024924:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962986624:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.024942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781910.024966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985728 00000100:00100000:3.0:1787781910.024970:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985728 00000100:00100000:3.0:1787781910.024997:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985984 00000100:00100000:3.0:1787781910.024999:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985984 00000100:00100000:3.0:1787781910.025017:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986496 00000100:00100000:3.0:1787781910.025019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986496 00000100:00100000:3.0:1787781910.025028:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985600 00000100:00100000:3.0:1787781910.025030:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985600 00000100:00100000:3.0:1787781910.025051:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986112 00000100:00100000:3.0:1787781910.025052:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986112 00000100:00100000:3.0:1787781910.025063:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962986624 00000100:00100000:3.0:1787781910.025064:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962986624 00000100:00100000:3.0:1787781910.025076:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787781910.025081:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962985728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025118:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962985728:12345-0@lo:400:kworker.0 Request processed in 37us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025125:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787781910.025137:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787781910.025142:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962985984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025166:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43caad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962985984:12345-0@lo:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025171:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787781910.025181:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787781910.025185:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962986496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025209:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962986496:12345-0@lo:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025214:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787781910.025225:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787781910.025230:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962985600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025256:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962985600:12345-0@lo:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025262:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787781910.025273:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787781910.025278:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962986112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025310:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962986112:12345-0@lo:400:kworker.0 Request processed in 33us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025315:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787781910.025325:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787781910.025329:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962986624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025349:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962986624:12345-0@lo:400:kworker.0 Request processed in 20us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.025354:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1787781910.025387:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781910.025390:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781910.025410:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962985600:0@lo:400:kworker.0 00010000:00080000:3.0:1787781910.025420:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd4000 x1874624962986112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781910.025428:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962986112:0@lo:400:kworker.0 00010000:00080000:3.0:1787781910.025435:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd4b40 x1874624962986624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781910.025442:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962986624:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025449:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962985984:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025456:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962986496:0@lo:400:kworker.0 00000100:00100000:3.0:1787781910.025490:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962985728:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.025558:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962985472 00000100:00100000:1.0:1787781910.025562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962985472 00000100:00100000:1.0:1787781910.025600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787781910.025629:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.025664:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962985472:12345-0@lo:400:kworker.0 Request processed in 59us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.025669:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787781910.025766:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962985472:0@lo:400:kworker.0 00000020:00000004:0.0:1787781910.038486:0:12807:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787781910.038846:0:12807:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787781910.534387:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781910.534419:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962987008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781910.534509:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.534647:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987008 00000100:00100000:1.0:1787781910.534657:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987008 00000100:00100000:1.0:1787781910.534718:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787781910.534728:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962987008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781910.534766:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781910.534816:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962987008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.534823:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1787781910.534867:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427561c0 x1874624962987008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.534903:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962987008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781910.535245:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962987136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781910.535274:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781910.535362:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987136 00000100:00100000:0.0:1787781910.535367:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987136 00000100:00100000:0.0:1787781910.535413:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787781910.535421:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962987136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781910.535433:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781910.535469:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962987136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781910.535476:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1787781910.535500:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427570c0 x1874624962987136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781910.535513:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962987136:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781910.602748:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781910.919935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781910.923684:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982912 00000100:00100000:2.0:1787781910.923702:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982912 00000100:00100000:2.0:1787781910.923793:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:2.0:1787781910.923804:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2405:x1874624942982912:12345-192.168.206.16@tcp:9:kworker.0 00000020:00000080:2.0:1787781910.923842:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506343e 00000100:00080000:2.0:1787781910.923854:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993d67f91800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787781910.923905:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787781910.924124:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+2:2405:x1874624942982912:12345-192.168.206.16@tcp:9:kworker.0 Request processed in 321us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781910.924132:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00080000:2.0:1787781910.924157:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787781910.924171:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781910.933101:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.933140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.933167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.933183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.933223:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.933254:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982528 00000100:00100000:1.0:1787781910.933264:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982528 00000100:00100000:1.0:1787781910.933331:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982784 00000100:00100000:1.0:1787781910.933334:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982784 00000100:00100000:1.0:1787781910.933343:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982400 00000100:00100000:1.0:1787781910.933345:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982400 00000100:00100000:1.0:1787781910.933355:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982656 00000100:00100000:1.0:1787781910.933357:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982656 00000100:00100000:1.0:1787781910.933384:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:1.0:1787781910.933402:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942982528:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781910.933488:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942982528:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 88us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.933496:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:1.0:1787781910.933513:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:1.0:1787781910.933518:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942982784:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781910.933550:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942982784:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.933556:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:1.0:1787781910.933565:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 180 00000100:00100000:1.0:1787781910.933571:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942982400:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781910.933597:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942982400:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.933603:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 180 00000100:00100000:1.0:1787781910.933633:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00100000:1.0:1787781910.933639:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942982656:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781910.933659:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942982656:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.933664:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00080000:1.0:1787781910.933688:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781910.933692:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781910.937956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942982272 00000100:00100000:3.0:1787781910.937984:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942982272 00000100:00100000:3.0:1787781910.938165:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 312 00000100:00100000:3.0:1787781910.938177:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942982272:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781910.939890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942982272:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 1704us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781910.939904:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 312 00000100:00100000:2.0:1787781910.945705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781910.946326:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983040 00000100:00100000:1.0:1787781910.946339:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983040 00000100:00100000:1.0:1787781910.946470:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:1.0:1787781910.946489:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2405:x1874624942983040:12345-192.168.206.16@tcp:9:kworker.0 00000020:00000080:1.0:1787781910.946527:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063445 00000100:00080000:1.0:1787781910.946550:0:8446:0:(import.c:65:import_set_state_nolock()) ffff993c437f6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781910.946625:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787781910.946825:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+2:2405:x1874624942983040:12345-192.168.206.16@tcp:9:kworker.0 Request processed in 338us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.946834:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00010000:00010000:1.0:1787781910.946857:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787781910.954744:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781911.049829:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781911.049987:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781911.050182:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962987392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781911.050225:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781911.050290:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987264 00000100:00100000:2.0:1787781911.050299:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987264 00000100:00100000:2.0:1787781911.050437:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987392 00000100:00100000:2.0:1787781911.050448:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987392 00000100:00100000:2.0:1787781911.055630:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787781911.055658:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962987264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781911.055704:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781911.055819:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962987264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (5832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781911.055828:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1787781911.056531:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427552c0 x1874624962987264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781911.056559:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781911.056605:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787781911.056635:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962987392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787781911.056654:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781911.056717:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962987392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (6491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781911.056725:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787781911.059276:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b70c0 x1874624962987392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781911.059310:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962987392:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787781911.621828:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787781912.077168:0:12905:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787781912.077465:0:12905:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787781912.646000:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781913.095179:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962987520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781913.095275:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781913.095593:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987520 00000100:00100000:1.0:1787781913.095603:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987520 00000100:00100000:1.0:1787781913.095696:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787781913.095706:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962987520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781913.095746:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781913.095804:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962987520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781913.095812:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787781913.096040:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962987520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787781913.674121:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781914.694969:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781915.143354:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781915.143384:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962987648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781915.143472:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.146568:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987648 00000100:00100000:1.0:1787781915.146589:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987648 00000100:00100000:1.0:1787781915.146690:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787781915.146701:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962987648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781915.146743:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787781915.146767:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962988032:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.146819:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.146830:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962987648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.146837:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787781915.146859:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962988544:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.146861:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988032 00000100:00100000:1.0:1787781915.146865:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988032 00000100:00100000:3.0:1787781915.146895:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.146908:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787781915.146914:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962988032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.146915:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962989056:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.146938:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.146943:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962988032:12345-0@lo:400:kworker.0 Request processed in 30us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.146950:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787781915.146978:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962987648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781915.147007:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962988032:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.147030:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787781915.147038:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962988160:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.147051:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962987776:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.147064:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781915.147085:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.147090:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962988672:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.147108:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962988288:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.147109:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.147122:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962989184:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.147168:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988160 00000100:00100000:1.0:1787781915.147173:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988160 00000100:00100000:1.0:1787781915.147197:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787781915.147204:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.147295:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962987904:0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.148286:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.148375:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988544 00000100:00100000:3.0:1787781915.148382:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988544 00000100:00100000:1.0:1787781915.148385:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962988160:12345-0@lo:400:kworker.0 Request processed in 1179us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.148395:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787781915.148422:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988672 00000100:00100000:1.0:1787781915.148422:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989056 00000100:00100000:3.0:1787781915.148425:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988672 00000100:00100000:1.0:1787781915.148425:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989056 00000100:00100000:3.0:1787781915.148437:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989184 00000100:00100000:3.0:1787781915.148439:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989184 00000100:00100000:1.0:1787781915.148442:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787781915.148449:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962988544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.148450:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787781915.148495:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962988544:12345-0@lo:400:kworker.0 Request processed in 46us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781915.148516:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962988672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.148549:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962988672:12345-0@lo:400:kworker.0 Request processed in 36us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.161853:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787781915.161913:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787781915.161934:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962989056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.162049:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962989056:12345-0@lo:400:kworker.0 Request processed in 126us (15109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.162057:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787781915.162071:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787781915.162078:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962989184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.162569:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.162637:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962989184:12345-0@lo:400:kworker.0 Request processed in 558us (14354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.162645:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787781915.162720:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962988160:0@lo:400:kworker.0 00010000:00080000:1.0:1787781915.162739:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f64780 x1874624962988672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781915.162751:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962988672:0@lo:400:kworker.0 00010000:00080000:1.0:1787781915.162764:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ef480 x1874624962989184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781915.162773:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962989184:0@lo:400:kworker.0 00010000:00080000:1.0:1787781915.162786:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f652c0 x1874624962988544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781915.162794:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962988544:0@lo:400:kworker.0 00010000:00080000:1.0:1787781915.162805:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ef0c0 x1874624962989056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781915.162812:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962989056:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.162876:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987776 00000100:00100000:1.0:1787781915.162884:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987776 00000100:00100000:1.0:1787781915.162925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787781915.162932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962987776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.164469:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787781915.164553:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781915.164560:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781915.164585:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988288 00000100:00100000:3.0:1787781915.164594:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988288 00000100:00100000:3.0:1787781915.164672:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787781915.164683:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962988288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.164843:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962988800:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.164904:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781915.164944:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988800 00000100:00100000:0.0:1787781915.164948:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988800 00000100:00100000:0.0:1787781915.164979:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787781915.164986:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42756940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962988800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.165023:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624962988800:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781915.165030:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787781915.165072:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624962988800:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165237:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781915.165264:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962987904 00000100:00100000:2.0:1787781915.165267:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962987904 00000100:00100000:2.0:1787781915.165297:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787781915.165303:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962987904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165335:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624962987904:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781915.165340:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787781915.165380:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624962987904:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165388:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962988416:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165411:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781915.165429:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988416 00000100:00100000:2.0:1787781915.165432:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988416 00000100:00100000:2.0:1787781915.165454:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787781915.165460:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165488:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624962988416:12345-0@lo:400:kworker.0 Request processed in 29us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781915.165494:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00080000:2.0:1787781915.165522:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f64b40 x1874624962988416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781915.165533:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624962988416:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165541:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962988928:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165564:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781915.165581:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962988928 00000100:00100000:2.0:1787781915.165584:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962988928 00000100:00100000:2.0:1787781915.165619:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787781915.165626:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962988928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.165653:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624962988928:12345-0@lo:400:kworker.0 Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781915.165665:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00080000:2.0:1787781915.165691:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ec3c0 x1874624962988928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781915.165700:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624962988928:0@lo:400:kworker.0 00000100:00080000:2.0:1787781915.165736:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781915.165739:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781915.165742:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962987776:12345-0@lo:400:kworker.0 Request processed in 2808us (18654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.165751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787781915.165869:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962987776:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.171246:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42756d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624962988288:12345-0@lo:400:kworker.0 Request processed in 6553us (8666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781915.171262:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787781915.171266:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624962988288:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.655553:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781915.655582:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962989312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781915.656137:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781915.656189:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989312 00000100:00100000:2.0:1787781915.656199:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989312 00000100:00100000:2.0:1787781915.656254:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787781915.656264:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962989312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781915.656301:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781915.656362:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962989312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781915.656370:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1787781915.658126:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1e940 x1874624962989312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781915.658164:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962989312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781915.658922:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781915.658940:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962989440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781915.659036:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.659506:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989440 00000100:00100000:3.0:1787781915.659515:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989440 00000100:00100000:3.0:1787781915.659575:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787781915.659585:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962989440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781915.659642:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781915.659703:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962989440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781915.659711:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1787781915.660031:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f1e940 x1874624962989440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781915.660052:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962989440:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787781915.718409:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781916.041876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781916.041961:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781916.050386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781916.050420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781916.056378:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983296 00000100:00100000:0.0:1787781916.056397:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983296 00000100:00100000:0.0:1787781916.056496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983552 00000100:00100000:0.0:1787781916.056500:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983552 00000100:00100000:0.0:1787781916.056533:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:0.0:1787781916.056544:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942983296:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781916.056659:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942983296:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 116us (14796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781916.056667:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:0.0:1787781916.056687:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00100000:0.0:1787781916.056693:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942983552:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781916.056717:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942983552:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (14756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781916.056723:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00080000:0.0:1787781916.056749:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781916.057220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781916.057245:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983168 00000100:00100000:1.0:1787781916.057250:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983168 00000100:00100000:1.0:1787781916.057280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 314 00000100:00100000:1.0:1787781916.057288:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942983168:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781916.057324:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942983168:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 37us (6952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781916.057331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 314 00000100:00100000:3.0:1787781916.057823:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983424 00000100:00100000:3.0:1787781916.057830:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983424 00000100:00100000:3.0:1787781916.057875:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983680 00000100:00100000:3.0:1787781916.057878:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983680 00000100:00100000:3.0:1787781916.057953:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:3.0:1787781916.057962:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942983424:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781916.058002:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942983424:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 42us (7581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781916.058009:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:3.0:1787781916.058021:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00100000:3.0:1787781916.058027:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942983680:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781916.058047:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942983680:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781916.058053:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00080000:1.0:1787781916.058660:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781916.167106:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781916.167136:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962989568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781916.167221:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781916.167297:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989568 00000100:00100000:3.0:1787781916.167305:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989568 00000100:00100000:3.0:1787781916.167376:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787781916.167387:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962989568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781916.167436:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781916.167488:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962989568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781916.167496:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1787781916.167542:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d2c0 x1874624962989568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781916.167563:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962989568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781916.179629:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781916.179657:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962989696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781916.179748:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781916.179810:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989696 00000100:00100000:0.0:1787781916.179828:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989696 00000100:00100000:0.0:1787781916.179881:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787781916.179892:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962989696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781916.179918:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781916.179968:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962989696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781916.179975:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787781916.180017:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427570c0 x1874624962989696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781916.180039:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962989696:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787781916.194307:0:13050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787781916.681869:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00100000:3.0:1787781916.681873:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000020:00000080:3.0:1787781916.681882:0:8439:0:(genops.c:885:class_export_put()) final put ffff993d67f91000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000020:00000080:2.0:1787781916.681882:0:9524:0:(genops.c:885:class_export_put()) final put ffff993c437f0000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000020:00000080:0.0:1787781916.682018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67f91000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 for lustre-OST0000 00000020:00000080:0.0:1787781916.682097:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d67f91800 for lustre-OST0000 00000020:00000080:1.0:1787781916.682151:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff993c437f0000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 for lustre-OST0001 00000020:00000080:1.0:1787781916.682186:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c437f6000 for lustre-OST0001 00010000:00010000:2.0:1787781916.748545:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781917.774995:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781918.215348:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962989824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781918.215439:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781918.216100:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962989824 00000100:00100000:1.0:1787781918.216111:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962989824 00000100:00100000:1.0:1787781918.216190:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781918.216201:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962989824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781918.216242:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781918.216314:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962989824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781918.216322:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787781918.216541:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962989824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781918.791056:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787781919.529111:0:13198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb0f59140 20000000:00000080:2.0:1787781919.529135:0:13198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993d7c4e0c00 uarg=0000000000000000 20000000:01000000:2.0:1787781919.529195:0:13198:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781919.529202:0:13198:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781919.529208:0:13198:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787781919.529849:0:13199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787781919.530033:0:13198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787781919.538044:0:13198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787781919.538255:0:13198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538280:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538290:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538297:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538305:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150633ff expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538312:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506340d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538352:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538361:0:13198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538414:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538431:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 12 pid: 6525 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.538448:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962989952:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781919.538583:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538591:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 23 pid: 6526 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.538600:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990080:0@lo:104: 00000100:00100000:3.0:1787781919.538679:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781919.538730:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538739:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 23 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.538747:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990208:0@lo:104: 00000100:00100000:3.0:1787781919.538779:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781919.538800:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538809:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 23 pid: 6525 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.538817:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990336:0@lo:104: 00000100:00100000:3.0:1787781919.538839:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781919.538856:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.538864:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 23 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781919.538984:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990080 00000100:00100000:0.0:1787781919.538994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990080 00000100:00100000:0.0:1787781919.539038:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990208 00000100:00100000:0.0:1787781919.539041:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990208 00000100:00100000:0.0:1787781919.539050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990336 00000100:00100000:0.0:1787781919.539053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990336 00000100:00100000:0.0:1787781919.539066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781919.539074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:13198:x1874624962990080:12345-0@lo:104: 00010000:00010000:0.0:1787781919.539088:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539143:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781919.539156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:13198:x1874624962990080:12345-0@lo:104: Request processed in 83us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.539164:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781919.539183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787781919.539189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:13198:x1874624962990208:12345-0@lo:104: 00010000:00010000:0.0:1787781919.539197:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539229:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781919.539233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:13198:x1874624962990208:12345-0@lo:104: Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.539238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787781919.539248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781919.539253:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13198:x1874624962990336:12345-0@lo:104: 00010000:00010000:0.0:1787781919.539261:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539288:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787781919.539292:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13198:x1874624962990336:12345-0@lo:104: Request processed in 40us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.539297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1787781919.539313:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787781919.539331:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539339:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781919.539344:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539364:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781919.539372:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781919.539377:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787781919.539417:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539424:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781919.539448:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539456:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704800/0xc6d6745c1506340d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539472:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781919.539476:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539482:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705e00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781919.539485:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539491:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781919.539497:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781919.539509:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787781919.539524:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539531:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781919.539546:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539553:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43705e00/0xc6d6745c150633ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063406 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539563:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781919.539566:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539571:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781919.539574:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539580:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781919.539586:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781919.539591:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787781919.539604:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539629:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781919.539643:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43705a00/0xc6d6745c150633f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633f8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.539658:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781919.539660:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781919.539662:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781919.539669:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781919.539675:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781919.539690:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962990592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787781919.539726:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781919.539765:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962990720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787781919.539787:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781919.539804:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781919.539810:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962990848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787781919.539829:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781919.539859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990592 00000100:00100000:0.0:1787781919.539864:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990592 00010000:00010000:0.0:1787781919.539971:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 24 pid: 6526 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781919.539995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990720 00000100:00100000:0.0:1787781919.539998:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990720 00010000:00010000:0.0:1787781919.540009:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 25 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781919.540020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990848 00000100:00100000:0.0:1787781919.540022:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990848 00010000:00010000:0.0:1787781919.540043:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 26 pid: 6525 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781919.540057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781919.540064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3658:x1874624962990592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787781919.540076:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781919.540082:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 26 pid: 6526 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540092:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 26 pid: 6526 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540112:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781919.540143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3658:x1874624962990592:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.540150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781919.540165:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781919.540171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3659:x1874624962990720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787781919.540178:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781919.540183:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 25 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540191:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 25 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540201:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781919.540223:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+25:3659:x1874624962990720:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.540230:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781919.540249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781919.540255:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962990848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787781919.540262:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781919.540267:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 24 pid: 6525 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540275:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 24 pid: 6525 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.540285:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781919.540307:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624962990848:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781919.540313:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781919.540367:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962990592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787781919.540395:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962990848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787781919.540402:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624962990720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781919.540491:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990464:0@lo:104: 00000100:00100000:3.0:1787781919.540542:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781919.540594:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.540627:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.540639:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990976:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781919.540686:0:13198:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787781919.540699:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704c00/0xc6d6745c15063414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506340d expref: 23 pid: 6526 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.540711:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990080:0@lo:104: 00010000:00010000:3.0:1787781919.540719:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039200/0xc6d6745c15063406 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150633ff expref: 22 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.540737:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990208:0@lo:104: 00010000:00010000:3.0:1787781919.540749:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e600/0xc6d6745c150633f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150633f1 expref: 21 pid: 6525 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.540757:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990336:0@lo:104: 00000100:00100000:2.0:1787781919.540999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962990464 00000100:00100000:2.0:1787781919.541004:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962990464 00000100:00100000:2.0:1787781919.541029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781919.541038:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13198:x1874624962990464:12345-0@lo:104: 00010000:00010000:2.0:1787781919.541049:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541097:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781919.541102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13198:x1874624962990464:12345-0@lo:104: Request processed in 67us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781919.541109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787781919.541132:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781919.541137:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541145:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787781919.541149:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541168:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787781919.541176:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781919.541182:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787781919.541210:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541218:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781919.541238:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541246:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150633e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150633ea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541263:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781919.541265:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781919.541266:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781919.541284:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962991104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781919.541316:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781919.541363:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991104 00000100:00100000:2.0:1787781919.541366:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991104 00010000:00010000:2.0:1787781919.541382:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 21 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781919.541402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787781919.541408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3657:x1874624962991104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781919.541427:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781919.541432:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 21 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541441:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 21 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781919.541455:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781919.541483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3657:x1874624962991104:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781919.541489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787781919.541517:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41cd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962991104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781919.542286:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039000/0xc6d6745c150633ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150633e3 expref: 20 pid: 6523 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.542301:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990464:0@lo:104: 00000100:00100000:0.0:1787781919.547667:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962989952:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781919.547686:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874624962990976:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781919.547727:0:13198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781919.548054:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781919.548147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781919.548535:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983808 00000100:00100000:3.0:1787781919.548547:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983808 00010000:00010000:3.0:1787781919.548592:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 13 pid: 6525 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.548794:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942983936 00000100:00100000:3.0:1787781919.548799:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942983936 00000100:00100000:1.0:1787781919.548895:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:1.0:1787781919.548908:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+14:2409:x1874624942983808:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781919.548945:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781919.548953:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 14 pid: 6525 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781919.548967:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 14 pid: 6525 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781919.548989:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e200/0xc6d6745c15063429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f9 expref: 14 pid: 6525 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781919.549007:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781919.549072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942983808:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 167us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.549081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 44 00010000:00010000:3.0:1787781919.549185:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781919.549217:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:3.0:1787781919.549226:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:2409:x1874624942983936:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781919.549235:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781919.549240:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549250:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549273:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704a00/0xc6d6745c150633dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ba expref: 12 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549285:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549294:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549308:0:9533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549315:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549333:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549340:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549347:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781919.549352:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549361:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549376:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781919.549398:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781919.549421:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:2409:x1874624942983936:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 198us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781919.549428:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 45 00010000:00010000:1.0:1787781919.549841:0:13198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781919.549850:0:13198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781919.549857:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705200/0xc6d6745c1506344c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781919.813839:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781920.266255:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962991232:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.266314:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962991616:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.266379:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.266385:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.266453:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962992128:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.266490:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.266517:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962992640:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.266561:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.266603:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992128 00000100:00100000:1.0:1787781920.266642:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992128 00000100:00100000:1.0:1787781920.266713:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992640 00000100:00100000:1.0:1787781920.266717:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992640 00000100:00100000:1.0:1787781920.266743:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787781920.266754:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962992128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267049:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42690780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962991744:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267081:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267100:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962992256:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267117:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267126:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962992768:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267150:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267178:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962991360:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267201:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267218:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962991872:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267236:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267249:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962992384:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267283:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787781920.267289:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962991488:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.267308:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.267338:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962992000:0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.267670:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991232 00000100:00100000:2.0:1787781920.267676:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991232 00000100:00100000:2.0:1787781920.267717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787781920.267725:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3658:x1874624962991232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.267773:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3658:x1874624962991232:12345-0@lo:400:kworker.0 Request processed in 49us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781920.267781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787781920.267824:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992256 00000100:00100000:2.0:1787781920.267828:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992256 00000100:00100000:2.0:1787781920.267851:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992768 00000100:00100000:2.0:1787781920.267854:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992768 00000100:00100000:2.0:1787781920.267871:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787781920.267877:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962992640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.267915:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962992640:12345-0@lo:400:kworker.0 Request processed in 38us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.267919:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962992128:12345-0@lo:400:kworker.0 Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.268064:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787781920.268093:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.268117:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962992512:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.268146:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.268165:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962992896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781920.268187:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.268238:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991616 00000100:00100000:0.0:1787781920.268243:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991616 00000100:00100000:3.0:1787781920.268251:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991360 00000100:00100000:3.0:1787781920.268269:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991360 00000100:00100000:0.0:1787781920.268269:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991872 00000100:00100000:0.0:1787781920.268275:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991872 00000100:00100000:3.0:1787781920.268299:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992384 00000100:00100000:3.0:1787781920.268304:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992384 00000100:00100000:0.0:1787781920.268314:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992000 00000100:00100000:0.0:1787781920.268330:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992000 00000100:00100000:3.0:1787781920.268339:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992512 00000100:00100000:3.0:1787781920.268344:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992512 00000100:00100000:2.0:1787781920.268816:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787781920.268837:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787781920.268846:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962992256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.268897:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962992256:12345-0@lo:400:kworker.0 Request processed in 54us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781920.268903:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787781920.268915:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787781920.268922:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962992768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.268948:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962992768:12345-0@lo:400:kworker.0 Request processed in 27us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781920.268953:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787781920.270745:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991744 00000100:00100000:2.0:1787781920.270763:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991744 00000100:00100000:2.0:1787781920.270807:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962991488 00000100:00100000:2.0:1787781920.270811:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962991488 00000100:00100000:2.0:1787781920.270824:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962992896 00000100:00100000:2.0:1787781920.270826:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962992896 00000100:00100000:2.0:1787781920.270840:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787781920.270849:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.270943:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962991744:12345-0@lo:400:kworker.0 Request processed in 95us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781920.270950:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787781920.270968:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787781920.270974:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624962991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.271018:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624962991488:12345-0@lo:400:kworker.0 Request processed in 44us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.271029:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787781920.271042:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787781920.271044:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962991616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.271055:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787781920.271059:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962992896:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781920.271084:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624962991616:12345-0@lo:400:kworker.0 Request processed in 45us (4706us total) trans 0 rc 0/0 00000004:00000024:2.0:1787781920.271086:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781920.271117:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962992896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781920.271133:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787781920.271761:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624962991616:0@lo:400:kworker.0 00010000:00080000:1.0:1787781920.271780:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a4000 x1874624962992128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781920.271790:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962992128:0@lo:400:kworker.0 00010000:00080000:1.0:1787781920.271800:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a4780 x1874624962992640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781920.271807:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962992640:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.272034:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962992896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781920.272057:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787781920.272086:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787781920.272097:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962991360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.272151:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962991360:12345-0@lo:400:kworker.0 Request processed in 58us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.272157:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787781920.272168:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787781920.272174:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962991872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.272198:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624962991872:12345-0@lo:400:kworker.0 Request processed in 25us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.272203:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787781920.272214:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787781920.272225:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.272243:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962991488:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.272265:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962991360:0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.272270:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962992384:12345-0@lo:400:kworker.0 Request processed in 46us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.272284:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624962991872:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.272296:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962992384:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.273273:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787781920.273293:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962992000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.273377:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962992000:12345-0@lo:400:kworker.0 Request processed in 93us (6017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.273385:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787781920.273412:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787781920.273420:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962992512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.273452:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962992512:12345-0@lo:400:kworker.0 Request processed in 33us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.273486:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:0.0:1787781920.273535:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a7840 x1874624962992000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781920.273649:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1787781920.273676:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781920.273683:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781920.273686:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781920.273689:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781920.273735:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962992000:0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.273736:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624962991232:0@lo:400:kworker.0 00010000:00080000:0.0:1787781920.273762:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a43c0 x1874624962992512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781920.273765:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42690780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962991744:0@lo:400:kworker.0 00000100:00100000:0.0:1787781920.273780:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962992512:0@lo:400:kworker.0 00010000:00080000:2.0:1787781920.273785:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a5680 x1874624962992256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781920.273796:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962992256:0@lo:400:kworker.0 00010000:00080000:2.0:1787781920.273813:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a52c0 x1874624962992768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781920.273823:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962992768:0@lo:400:kworker.0 00000100:00100000:2.0:1787781920.660036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781920.660350:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984064 00000100:00100000:0.0:1787781920.660364:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984064 00000100:00100000:0.0:1787781920.660862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 316 00000100:00100000:0.0:1787781920.660875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:6192:x1874624942984064:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781920.660898:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781920.660922:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8392a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781920.660956:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781920.660969:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781920.660979:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9a00, rc 0) 00000100:00100000:0.0:1787781920.661056:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984064:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 184us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.661064:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 316 00000100:00100000:2.0:1787781920.664188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781920.664471:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984192 00000100:00100000:3.0:1787781920.664484:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984192 00000100:00100000:3.0:1787781920.664551:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 317 00000100:00100000:3.0:1787781920.664562:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984192:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781920.665688:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984192:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 1119us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.665699:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 317 00000100:00100000:3.0:1787781920.670771:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781920.671520:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984320 00000100:00100000:0.0:1787781920.671533:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984320 00000100:00100000:0.0:1787781920.671630:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 318 00000100:00100000:0.0:1787781920.671643:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984320:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781920.671827:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984320:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 185us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.671837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 318 00000100:00100000:2.0:1787781920.683844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781920.684707:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984448 00000100:00100000:3.0:1787781920.684721:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984448 00000100:00100000:3.0:1787781920.684836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 319 00000100:00100000:3.0:1787781920.684849:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942984448:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781920.684882:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781920.684909:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83931 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781920.684945:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781920.684983:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781920.684994:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704a00, rc 0) 00000100:00100000:3.0:1787781920.685075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942984448:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 228us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.685083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 319 00000100:00100000:3.0:1787781920.686712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781920.686793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984576 00000100:00100000:0.0:1787781920.686804:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984576 00000100:00100000:0.0:1787781920.686858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 320 00000100:00100000:0.0:1787781920.686876:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942984576:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781920.687180:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942984576:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 313us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.687189:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 320 00000100:00100000:1.0:1787781920.690425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781920.690567:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984704 00000100:00100000:3.0:1787781920.690580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984704 00000100:00100000:3.0:1787781920.691525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 321 00000100:00100000:3.0:1787781920.691540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942984704:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781920.691729:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942984704:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 193us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.691737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 321 00000100:00100000:2.0:1787781920.774094:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962993024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781920.774189:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781920.774307:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993024 00000100:00100000:3.0:1787781920.774327:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993024 00000100:00100000:3.0:1787781920.774401:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787781920.774413:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962993024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781920.774451:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781920.777850:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962993152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781920.777937:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781920.778470:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993152 00000100:00100000:0.0:1787781920.778481:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993152 00000100:00100000:0.0:1787781920.778534:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787781920.778544:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962993152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781920.778573:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781920.778651:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962993152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781920.778660:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787781920.778725:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ec3c0 x1874624962993152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781920.778748:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962993152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781920.780026:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962993024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5608us (5830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.780038:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1787781920.780476:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a6d00 x1874624962993024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781920.780501:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962993024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781920.844972:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781921.159999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781921.160129:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984832 00000100:00100000:1.0:1787781921.160141:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984832 00000100:00100000:1.0:1787781921.160282:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00100000:1.0:1787781921.160296:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942984832:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781921.160397:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942984832:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 104us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781921.160405:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00080000:2.0:1787781921.161663:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781921.180195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781921.180253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781921.180291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781921.180348:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985088 00000100:00100000:0.0:1787781921.180360:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985088 00000100:00100000:0.0:1787781921.180432:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942984960 00000100:00100000:0.0:1787781921.180435:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942984960 00000100:00100000:0.0:1787781921.180453:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985216 00000100:00100000:0.0:1787781921.180455:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985216 00000100:00100000:0.0:1787781921.180474:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 199 00000100:00100000:0.0:1787781921.180485:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985088:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781921.180578:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985088:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.180586:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 199 00000100:00100000:0.0:1787781921.180622:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:0.0:1787781921.180632:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942984960:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781921.180660:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942984960:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.180666:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:0.0:1787781921.180693:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 201 00000100:00100000:0.0:1787781921.180700:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985216:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781921.180726:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985216:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.180732:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 201 00000100:00080000:0.0:1787781921.180753:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781921.180774:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781921.286080:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42755e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962993280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781921.286173:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.286744:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993280 00000100:00100000:0.0:1787781921.286756:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993280 00000100:00100000:0.0:1787781921.286816:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787781921.286840:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962993280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781921.286880:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781921.286952:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962993280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.286960:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1787781921.289741:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c42755e00 x1874624962993280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781921.289792:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42755e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962993280:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1787781921.289996:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787781921.290001:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7c44e000 from 7 10000000:01000000:0.0:1787781921.290006:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781921.290048:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.290059:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.290070:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781921.290094:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.290174:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.290236:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.292128:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993536 00000100:00100000:3.0:1787781921.292144:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993536 00000100:00100000:3.0:1787781921.292228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787781921.292241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624962993536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781921.292261:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781921.292282:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063461 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.292327:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063461 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.292342:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063461 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.292352:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705c00, rc 0) 00000100:00100000:3.0:1787781921.292437:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.292445:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787781921.293137:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781921.293163:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.293175:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781921.293305:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.293366:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.293412:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.293534:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993664 00000100:00100000:3.0:1787781921.293539:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993664 00000100:00100000:3.0:1787781921.293582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787781921.293591:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781921.293758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.293767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787781921.293972:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.294007:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.294049:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.294081:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.294131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993792 00000100:00100000:3.0:1787781921.294136:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993792 00000100:00100000:3.0:1787781921.294171:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787781921.294178:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781921.294273:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.294281:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787781921.295381:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781921.297001:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962993408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781921.297089:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.297900:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993408 00000100:00100000:0.0:1787781921.297913:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993408 00000100:00100000:0.0:1787781921.297971:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787781921.297983:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962993408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781921.298013:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781921.298076:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962993408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.298084:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787781921.298813:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a6d00 x1874624962993408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781921.298851:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962993408:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787781921.300036:0:13248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787781921.300920:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787781921.300953:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781921.300968:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.300983:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781921.300997:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787781921.301016:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7236f800 from 7 10000000:01000000:0.0:1787781921.301020:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781921.301067:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.301076:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.301088:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781921.301120:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.301205:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.304423:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.312945:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962993920 00000100:00100000:3.0:1787781921.312965:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962993920 00000100:00100000:1.0:1787781921.313394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787781921.313408:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624962993920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781921.313429:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781921.313453:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506346f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781921.313504:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506346f expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781921.313518:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506346f expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781921.313529:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039400, rc 0) 00000100:00100000:1.0:1787781921.315382:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962993920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1962us (14162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781921.315397:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787781921.323736:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42757c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962993920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781921.323776:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.323792:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781921.323899:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.323974:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781921.324019:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781921.324788:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994048 00000100:00100000:0.0:1787781921.324799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994048 00000100:00100000:0.0:1787781921.324903:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787781921.324914:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962994048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.325088:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962994048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.325096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787781921.325189:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.325256:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.325327:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781921.328785:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.331338:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994176 00000100:00100000:3.0:1787781921.331357:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994176 00000100:00100000:3.0:1787781921.331437:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787781921.331449:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962994176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781921.331692:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962994176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (6364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.331701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787781921.334256:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787781921.339814:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787781921.340969:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787781921.340998:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781921.341012:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.341025:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781921.341039:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781921.341042:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d80a11800 from 7 10000000:01000000:3.0:1787781921.341045:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781921.341093:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.341114:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.341128:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781921.341161:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781921.341340:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781921.341395:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f41840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781921.344373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994304 00000100:00100000:2.0:1787781921.344401:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994304 00000100:00100000:2.0:1787781921.344483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787781921.344495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624962994304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781921.344516:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781921.344538:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506347d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.344574:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506347d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.344588:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506347d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.344598:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e400, rc 0) 00000100:00100000:2.0:1787781921.344792:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 298us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781921.344800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787781921.345965:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781921.345997:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.346010:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781921.346118:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.346172:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781921.346216:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781921.346515:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994432 00000100:00100000:1.0:1787781921.346523:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994432 00000100:00100000:1.0:1787781921.346568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787781921.346578:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781921.348979:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2394us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781921.348995:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787781921.349403:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.349480:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.349541:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781921.349650:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781921.354975:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994560 00000100:00100000:0.0:1787781921.354996:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994560 00000100:00100000:0.0:1787781921.355080:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787781921.355092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.355307:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.355327:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787781921.355370:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787781921.356634:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787781921.357373:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787781921.357404:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781921.357417:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.357430:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781921.357443:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787781921.357446:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d47267800 from 7 10000000:01000000:2.0:1787781921.357449:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781921.357494:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.357503:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781921.357515:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781921.357548:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781921.357650:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781921.357712:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781921.357951:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994688 00000100:00100000:3.0:1787781921.357961:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994688 00000100:00100000:3.0:1787781921.358091:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787781921.358102:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624962994688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781921.358119:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781921.358136:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506348b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.358166:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506348b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.358178:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506348b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781921.358188:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705000, rc 0) 00000100:00100000:3.0:1787781921.358334:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962994688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.358348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787781921.358435:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ca9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781921.358457:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.358467:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781921.358537:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.358569:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.358587:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781921.358600:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994816 00000100:00100000:0.0:1787781921.358603:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994816 00000100:00100000:0.0:1787781921.358997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787781921.359080:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962994816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.359216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962994816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781921.359504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787781921.359549:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.359592:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781921.359954:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781921.360031:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781921.363173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962994944 00000100:00100000:2.0:1787781921.363192:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962994944 00000100:00100000:3.0:1787781921.363585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787781921.363598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962994944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781921.363816:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624962994944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781921.363825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787781921.364901:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42754780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624962994944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787781921.371147:0:13254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787781921.371426:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787781921.371451:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787781921.371465:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781921.371479:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781921.861814:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781922.886772:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781923.334380:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781923.334409:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962995072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781923.334506:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781923.334661:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995072 00000100:00100000:2.0:1787781923.334673:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995072 00000100:00100000:2.0:1787781923.334725:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787781923.334735:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962995072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781923.334773:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781923.334828:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962995072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781923.334836:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787781923.334886:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962995072:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787781923.910999:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787781924.029969:0:13396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787781924.934072:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781925.381802:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781925.381911:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781925.381937:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962995328:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.382037:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781925.382119:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995328 00000100:00100000:3.0:1787781925.382129:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995328 00000100:00100000:3.0:1787781925.382202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787781925.382213:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962995328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781925.382273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624962995328:12345-0@lo:400:kworker.0 Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.382281:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787781925.382339:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624962995328:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.382681:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962995200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781925.382722:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384470:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962995456:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.384530:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781925.384674:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962995840:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.384708:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781925.384727:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962996352:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.384747:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781925.384768:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787781925.384775:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962995712:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.384798:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384852:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962995968:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.384878:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384897:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962996480:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.384916:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384926:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787781925.384930:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962995584:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.384949:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384958:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962996096:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.384979:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.384996:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962996608:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.385018:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.385051:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995456 00000100:00100000:3.0:1787781925.385053:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995840 00000100:00100000:3.0:1787781925.385058:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995840 00000100:00100000:2.0:1787781925.385058:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995456 00000100:00100000:2.0:1787781925.385113:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996352 00000100:00100000:2.0:1787781925.385116:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996352 00000100:00100000:1.0:1787781925.385276:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962996224:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385314:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781925.385332:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962996736:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781925.385394:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996096 00000100:00100000:1.0:1787781925.385398:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996096 00000100:00100000:1.0:1787781925.385422:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996608 00000100:00100000:1.0:1787781925.385424:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996608 00000100:00100000:1.0:1787781925.385436:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996224 00000100:00100000:1.0:1787781925.385438:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996224 00000100:00100000:1.0:1787781925.385449:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996736 00000100:00100000:1.0:1787781925.385451:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996736 00000100:00100000:1.0:1787781925.385465:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787781925.385473:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962996096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385534:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962996096:12345-0@lo:400:kworker.0 Request processed in 61us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.385565:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787781925.385585:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787781925.385591:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962996608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385647:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624962996608:12345-0@lo:400:kworker.0 Request processed in 57us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.385653:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787781925.385665:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787781925.385670:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385700:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962996224:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.385706:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787781925.385717:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787781925.385723:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962996736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.385747:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962996736:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.385752:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1787781925.385792:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f64f00 x1874624962996224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781925.385807:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962996224:0@lo:400:kworker.0 00010000:00080000:1.0:1787781925.385818:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c81680 x1874624962996736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781925.385827:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962996736:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.386283:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995200 00000100:00100000:0.0:1787781925.386300:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995200 00000100:00100000:0.0:1787781925.386344:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995712 00000100:00100000:0.0:1787781925.386355:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995712 00000100:00100000:0.0:1787781925.386372:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787781925.386378:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962995200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787781925.386410:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781925.386463:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962995200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781925.386470:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787781925.386484:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787781925.386490:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962995712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.386522:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962995712:12345-0@lo:400:kworker.0 Request processed in 32us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781925.386528:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787781925.386694:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995968 00000100:00100000:0.0:1787781925.386699:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995968 00000100:00100000:1.0:1787781925.388101:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996480 00000100:00100000:1.0:1787781925.388131:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996480 00000100:00100000:3.0:1787781925.388693:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962995584 00000100:00100000:3.0:1787781925.388699:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962995584 00000100:00100000:3.0:1787781925.388730:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787781925.388742:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962995456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781925.388844:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624962995456:12345-0@lo:400:kworker.0 Request processed in 105us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.388852:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787781925.388874:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787781925.388882:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962995840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781925.388928:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624962995840:12345-0@lo:400:kworker.0 Request processed in 48us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.388935:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787781925.388948:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787781925.388955:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962995584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781925.388984:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624962995584:12345-0@lo:400:kworker.0 Request processed in 30us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.388990:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787781925.390904:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787781925.390930:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962996352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.391027:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624962996352:12345-0@lo:400:kworker.0 Request processed in 110us (6278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781925.391035:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787781925.391123:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624962995584:0@lo:400:kworker.0 00010000:00080000:2.0:1787781925.391144:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f643c0 x1874624962996096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781925.391157:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962996096:0@lo:400:kworker.0 00010000:00080000:2.0:1787781925.391172:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b7840 x1874624962996608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781925.391181:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624962996608:0@lo:400:kworker.0 00000100:00100000:2.0:1787781925.391195:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624962995456:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.391832:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787781925.391935:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962995968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.392003:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624962995968:12345-0@lo:400:kworker.0 Request processed in 162us (7124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781925.392010:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:0.0:1787781925.392032:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781925.392038:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781925.392056:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781925.392059:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781925.392111:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962995712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.392126:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624962995840:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.392138:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624962996352:0@lo:400:kworker.0 00000100:00100000:0.0:1787781925.392161:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962995200:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787781925.392247:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67f66580 x1874624962995968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781925.392260:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624962995968:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.392624:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787781925.392637:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962996480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.392688:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624962996480:12345-0@lo:400:kworker.0 Request processed in 55us (7770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.392694:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:3.0:1787781925.393738:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d799b7480 x1874624962996480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781925.393755:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624962996480:0@lo:400:kworker.0 00000100:00100000:1.0:1787781925.894678:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781925.894720:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962996864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781925.894809:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781925.895100:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996864 00000100:00100000:2.0:1787781925.895110:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996864 00000100:00100000:2.0:1787781925.895168:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787781925.895179:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962996864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781925.895217:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781925.895282:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624962996864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781925.895312:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787781925.895772:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781925.895785:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962996992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781925.895820:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781925.896036:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962996992 00000100:00100000:0.0:1787781925.896042:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962996992 00000100:00100000:0.0:1787781925.896080:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787781925.896089:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962996992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781925.896103:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781925.896148:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962996992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781925.896154:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787781925.896194:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43751e00 x1874624962996992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781925.896215:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962996992:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787781925.896907:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a43c0 x1874624962996864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781925.896925:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624962996864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787781925.962701:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781926.287989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781926.288121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985344 00000100:00100000:2.0:1787781926.288134:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985344 00000100:00100000:2.0:1787781926.288211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 335 00000100:00100000:2.0:1787781926.288223:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942985344:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781926.288332:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942985344:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.288341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 335 00000100:00100000:0.0:1787781926.292756:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781926.292874:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985472 00000100:00100000:2.0:1787781926.292887:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985472 00000100:00100000:2.0:1787781926.292975:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 208 00000100:00100000:2.0:1787781926.292987:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942985472:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781926.293083:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42754780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624942985472:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.293091:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 208 00000100:00080000:0.0:1787781926.293160:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781926.306891:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781926.307034:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985600 00000100:00100000:2.0:1787781926.307048:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985600 00000100:00100000:2.0:1787781926.307132:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 209 00000100:00100000:2.0:1787781926.307144:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942985600:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781926.307251:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942985600:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.307260:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 209 00000100:00080000:0.0:1787781926.307685:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781926.314035:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781926.314737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781926.314828:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985728 00000100:00100000:0.0:1787781926.314840:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985728 00000100:00100000:0.0:1787781926.314926:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985856 00000100:00100000:0.0:1787781926.314930:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985856 00000100:00100000:0.0:1787781926.314960:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 210 00000100:00100000:0.0:1787781926.314986:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942985728:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781926.315073:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942985728:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 90us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781926.315081:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 210 00000100:00100000:0.0:1787781926.315098:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 211 00000100:00100000:0.0:1787781926.315104:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985856:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781926.315127:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942985856:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781926.315133:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 211 00000100:00080000:1.0:1787781926.315383:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781926.315389:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781926.406154:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962997120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781926.406249:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781926.406542:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997120 00000100:00100000:1.0:1787781926.406554:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997120 00000100:00100000:1.0:1787781926.406638:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787781926.406650:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962997120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787781926.406685:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781926.406908:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781926.406923:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962997248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781926.406974:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781926.407107:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997248 00000100:00100000:3.0:1787781926.407113:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997248 00000100:00100000:3.0:1787781926.407153:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787781926.407162:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962997248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781926.407175:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781926.407218:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962997248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781926.407226:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787781926.407297:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c427561c0 x1874624962997248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781926.407319:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c427561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962997248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781926.409913:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624962997120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3250us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.409930:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1787781926.411674:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a61c0 x1874624962997120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781926.411711:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962997120:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787781926.983943:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781928.005801:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781928.458408:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962997376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781928.458501:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781928.459938:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997376 00000100:00100000:1.0:1787781928.459955:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997376 00000100:00100000:1.0:1787781928.460015:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781928.460024:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962997376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781928.460059:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781928.460137:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42757c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962997376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781928.460145:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781928.460196:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962997376:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787781929.029811:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781929.129465:0:13545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:05:27 (1787781927) === 00000100:00100000:1.0:1787781929.374089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.374142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.374209:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942985984 00000100:00100000:0.0:1787781929.374218:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942985984 00000100:00100000:0.0:1787781929.374298:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:0.0:1787781929.374309:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942985984:12345-192.168.206.16@tcp:41:mkdir.0 00000004:00000024:0.0:1787781929.374348:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781929.374437:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624942985984:12345-192.168.206.16@tcp:41:mkdir.0 Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781929.374447:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00080000:1.0:1787781929.374740:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781929.375982:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942986112 00000100:00100000:3.0:1787781929.376010:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942986112 00000100:00100000:3.0:1787781929.376111:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:3.0:1787781929.376120:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:10535:x1874624942986112:12345-192.168.206.16@tcp:700:mkdir.0 00000100:00100000:3.0:1787781929.376196:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:10535:x1874624942986112:12345-192.168.206.16@tcp:700:mkdir.0 Request processed in 77us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.376206:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:3.0:1787781929.389244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.389329:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942986368 00000100:00100000:2.0:1787781929.389339:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942986368 00000100:00100000:2.0:1787781929.389398:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:2.0:1787781929.389407:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:10535:x1874624942986368:12345-192.168.206.16@tcp:36:mkdir.0 00010000:00010000:2.0:1787781929.389472:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781929.390846:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506333b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838a5 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.390888:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:2.0:1787781929.390902:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781929.390994:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.391008:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.391018:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.391047:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.391055:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.391078:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.394931:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.394952:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.394965:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781929.394982:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b485806 reply state 000000008f2473fc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.394993:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395001:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:2.0:1787781929.395004:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781929.395007:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787781929.395014:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787781929.395021:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395029:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395036:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395042:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150fe00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781929.395061:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395070:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395081:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c436a4b00) 00010000:00010000:2.0:1787781929.395083:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781929.395087:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395407:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c15063499 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781929.395508:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b485806 reply state 000000008f2473fc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395519:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.395526:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993c436a4f00) 00010000:00010000:2.0:1787781929.395529:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781929.395531:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787781929.397192:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:10535:x1874624942986368:12345-192.168.206.16@tcp:36:mkdir.0 Request processed in 6272us (6443us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787781929.397206:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:2.0:1787781929.426673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.433419:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942986496 00000100:00100000:0.0:1787781929.433440:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942986496 00000100:00100000:0.0:1787781929.433511:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787781929.433523:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:10536:x1874624942986496:12345-192.168.206.16@tcp:101:chmod.0 00010000:00010000:0.0:1787781929.433544:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781929.433571:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83938 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433676:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433691:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433705:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781929.433751:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787781929.433756:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781929.433794:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433830:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83938 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433848:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83938 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.433856:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e4900) 00010000:00010000:0.0:1787781929.433859:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781929.433862:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8800, rc 0) 00000100:00100000:0.0:1787781929.433946:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:10536:x1874624942986496:12345-192.168.206.16@tcp:101:chmod.0 Request processed in 424us (7282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781929.433956:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787781929.436531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.436601:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942986752 00000100:00100000:1.0:1787781929.436643:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942986752 00000100:00100000:1.0:1787781929.436723:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:1.0:1787781929.436736:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:10536:x1874624942986752:12345-192.168.206.16@tcp:36:chmod.0 00010000:00010000:1.0:1787781929.436801:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781929.436837:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83938 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781929.436861:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e4900) 00010000:00010000:1.0:1787781929.436874:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781929.436905:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781929.436921:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781929.436934:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781929.439562:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e71fb469 reply state 0000000003003c47 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781929.439596:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781929.439623:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:1.0:1787781929.439627:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787781929.439632:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787781929.439646:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787781929.439788:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:10536:x1874624942986752:12345-192.168.206.16@tcp:36:chmod.0 Request processed in 3049us (3261us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787781929.439799:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:0.0:1787781929.486555:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.486713:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942986880 00000100:00100000:2.0:1787781929.486725:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942986880 00000100:00100000:2.0:1787781929.486789:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:2.0:1787781929.486801:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:10537:x1874624942986880:12345-192.168.206.16@tcp:101:chown.0 00010000:00010000:2.0:1787781929.486850:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781929.486876:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c150634c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8393f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.486953:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.486969:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.486982:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781929.487227:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787781929.487234:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781929.487294:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.487332:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150fe00/0xc6d6745c150634c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8393f expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.487357:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8393f expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.487367:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:2.0:1787781929.487371:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781929.487375:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d4150e600, rc 0) 00000100:00100000:3.0:1787781929.489444:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:10537:x1874624942986880:12345-192.168.206.16@tcp:101:chown.0 Request processed in 2630us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.489458:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:1.0:1787781929.491858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.491974:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942987008 00000100:00100000:0.0:1787781929.491985:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942987008 00000100:00100000:0.0:1787781929.492219:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:0.0:1787781929.492232:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:10537:x1874624942987008:12345-192.168.206.16@tcp:101:chown.0 00010000:00010000:0.0:1787781929.492332:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781929.492357:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83946 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492433:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492449:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492462:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492474:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492481:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492489:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492599:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492830:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492839:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781929.492894:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787781929.492898:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781929.492921:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492935:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492942:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492950:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492957:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.492962:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492970:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.492984:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:0.0:1787781929.492994:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781929.493067:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493143:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150634d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493162:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493169:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493176:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493181:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.493185:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493191:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493200:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993c436a4f00) 00010000:00010000:0.0:1787781929.493203:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781929.493206:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493213:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150634df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493326:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83946 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493355:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83946 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.493364:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:0.0:1787781929.493366:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781929.493369:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8800, rc 0) 00000100:00100000:0.0:1787781929.493490:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10537:x1874624942987008:12345-192.168.206.16@tcp:101:chown.0 Request processed in 1259us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781929.493500:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:0.0:1787781929.498595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.498997:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942987136 00000100:00100000:2.0:1787781929.499010:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942987136 00000100:00100000:1.0:1787781929.501253:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:1.0:1787781929.501290:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10537:x1874624942987136:12345-192.168.206.16@tcp:900:chown.0 00000100:00100000:1.0:1787781929.501411:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10537:x1874624942987136:12345-192.168.206.16@tcp:900:chown.0 Request processed in 144us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781929.501420:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:3.0:1787781929.507048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.507152:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942987392 00000100:00100000:0.0:1787781929.507172:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942987392 00000100:00100000:0.0:1787781929.507252:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:0.0:1787781929.507278:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10537:x1874624942987392:12345-192.168.206.16@tcp:36:chown.0 00010000:00010000:0.0:1787781929.507347:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781929.507392:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83946 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.507424:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:0.0:1787781929.507430:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781929.507457:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.507470:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.507480:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781929.513055:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1787781929.513213:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba4dc332 reply state 0000000076c1ca33 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.513252:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.513264:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:0.0:1787781929.513279:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787781929.513285:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787781929.513302:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1787781929.513431:0:6532:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787781929.513459:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:10537:x1874624942987392:12345-192.168.206.16@tcp:36:chown.0 Request processed in 6190us (6417us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787781929.513470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 28 00010000:00010000:2.0:1787781929.513805:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513826:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513834:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513841:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781929.513846:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513855:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513868:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:2.0:1787781929.513871:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787781929.513876:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.513882:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150634ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514028:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514037:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514044:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514049:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.514052:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514059:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514071:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993c436a4f00) 00010000:00010000:3.0:1787781929.514074:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.514088:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514094:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150f600/0xc6d6745c150634a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514118:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514125:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514131:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514136:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150e200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.514140:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514146:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514154:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:3.0:1787781929.514157:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.514159:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514176:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e200/0xc6d6745c150634a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514194:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514201:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514213:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514217:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.514219:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514236:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514245:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:3.0:1787781929.514248:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787781929.514251:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.514257:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c150634bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781929.540775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.541601:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942987520 00000100:00100000:1.0:1787781929.541679:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942987520 00000100:00100000:0.0:1787781929.541856:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:0.0:1787781929.541878:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:10538:x1874624942987520:12345-192.168.206.16@tcp:101:touch.500 00010000:00010000:0.0:1787781929.541907:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781929.541933:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8394d expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781929.542921:0:10060:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 930us 00010000:00010000:3.0:1787781929.574807:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.574850:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.574865:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.574883:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.574905:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.574913:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575401:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575424:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575433:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781929.575474:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787781929.575478:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781929.575527:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575683:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575691:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575697:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575702:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.575706:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575720:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575733:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:3.0:1787781929.575737:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.575742:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575748:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c150634fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575761:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575767:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575773:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575778:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.575780:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575786:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575792:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993d6d095100) 00010000:00010000:3.0:1787781929.575795:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.575798:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.575813:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.576335:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150634f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8394d expref: 8 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.576357:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8394d expref: 7 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.576365:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:3.0:1787781929.576367:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787781929.576369:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705800, rc 0) 00000100:00100000:3.0:1787781929.576855:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:10538:x1874624942987520:12345-192.168.206.16@tcp:101:touch.500 Request processed in 34969us (36082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.576866:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:1.0:1787781929.593822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.593938:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942987776 00000100:00100000:3.0:1787781929.593951:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942987776 00000100:00100000:3.0:1787781929.594146:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:3.0:1787781929.594159:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:10538:x1874624942987776:12345-192.168.206.16@tcp:101:touch.500 00010000:00010000:3.0:1787781929.594185:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781929.594210:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063510 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83954 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.594353:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.594371:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.594397:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.596814:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.596842:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.596866:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781929.597424:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787781929.597598:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063525 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597638:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597647:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597685:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597692:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597699:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597705:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.597717:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597725:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597738:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:3.0:1787781929.597741:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.597746:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597752:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781929.597765:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000368b0b4b reply state 00000000ddd5758f transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597776:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597782:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee0b5fa0 (ffff993d6d095100) 00010000:00010000:3.0:1787781929.597784:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781929.597787:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787781929.597829:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063510 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83954 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597844:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83954 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.597852:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993d6d095000) 00010000:00010000:3.0:1787781929.597854:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781929.597861:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705200, rc 0) 00000100:00100000:3.0:1787781929.602460:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:10538:x1874624942987776:12345-192.168.206.16@tcp:101:touch.500 Request processed in 8288us (8635us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787781929.602476:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:0.0:1787781929.614873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.615427:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988032 00000100:00100000:2.0:1787781929.615440:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988032 00000100:00100000:2.0:1787781929.615516:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:2.0:1787781929.615527:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:10538:x1874624942988032:12345-192.168.206.16@tcp:36:touch.500 00010000:00010000:2.0:1787781929.615597:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781929.615650:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063525 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83954 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.615685:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993d6d095000) 00010000:00010000:2.0:1787781929.615701:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781929.615772:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.615788:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.615799:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781929.615944:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005149ba71 reply state 0000000030d135ba transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.615958:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.615965:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:2.0:1787781929.615967:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781929.615970:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781929.617161:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10538:x1874624942988032:12345-192.168.206.16@tcp:36:touch.500 Request processed in 1625us (2291us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787781929.617174:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:2.0:1787781929.625702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.626116:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988160 00000100:00100000:0.0:1787781929.626128:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988160 00000100:00100000:0.0:1787781929.626274:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 32 00000100:00100000:0.0:1787781929.626287:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:10538:x1874624942988160:12345-192.168.206.16@tcp:101:touch.500 00010000:00010000:0.0:1787781929.626317:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781929.626343:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506353a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8395b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.626442:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506353a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8395b expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.626460:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506353a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8395b expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.626483:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:0.0:1787781929.626487:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781929.626492:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781929.626577:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:10538:x1874624942988160:12345-192.168.206.16@tcp:101:touch.500 Request processed in 292us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781929.626585:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 32 00000100:00100000:0.0:1787781929.634632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.637930:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988288 00000100:00100000:1.0:1787781929.637951:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988288 00000100:00100000:1.0:1787781929.638068:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787781929.638078:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1874624942988288:12345-192.168.206.16@tcp:8:touch.500 00010000:00080000:1.0:1787781929.638119:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 366 last 0 00000020:00000080:1.0:1787781929.638168:0:8446:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c15063541 00002000:00100000:1.0:1787781929.638182:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd0eda9e-1cb2-4b8a-8952-0f785606e4c5/ffff993d67f83000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787781929.638203:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787781929.638310:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787781929.638350:0:8446:0:(import.c:65:import_set_state_nolock()) ffff993d67f87000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781929.638464:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942988288:12345-192.168.206.16@tcp:8:touch.500 Request processed in 385us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781929.638473:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787781929.642048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.642171:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988416 00000100:00100000:2.0:1787781929.642189:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988416 00000100:00100000:2.0:1787781929.642286:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:2.0:1787781929.642297:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942988416:12345-192.168.206.16@tcp:2:touch.500 00000100:00080000:1.0:1787781929.642681:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787781929.654195:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787781929.654217:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000100:00100000:2.0:1787781929.660767:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:0:x1874624942988416:12345-192.168.206.16@tcp:2:touch.500 Request processed in 18456us (18716us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787781929.660784:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:3.0:1787781929.663718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.664155:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988672 00000100:00100000:1.0:1787781929.664167:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988672 00000100:00100000:1.0:1787781929.664238:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:1.0:1787781929.664250:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:10538:x1874624942988672:12345-192.168.206.16@tcp:35:touch.500 00000100:00100000:1.0:1787781929.664827:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:10538:x1874624942988672:12345-192.168.206.16@tcp:35:touch.500 Request processed in 567us (1112us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787781929.664837:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:0.0:1787781929.702730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.702848:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942988800 00000100:00100000:3.0:1787781929.702861:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942988800 00000100:00100000:3.0:1787781929.702932:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:3.0:1787781929.702944:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:10539:x1874624942988800:12345-192.168.206.16@tcp:101:rm.0 00010000:00010000:3.0:1787781929.702973:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781929.702998:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83962 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703083:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703100:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703113:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781929.703170:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787781929.703175:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781929.703220:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703250:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83962 expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703298:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83962 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.703307:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:3.0:1787781929.703310:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781929.703314:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705400, rc 0) 00000100:00100000:3.0:1787781929.703408:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:10539:x1874624942988800:12345-192.168.206.16@tcp:101:rm.0 Request processed in 466us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.703415:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:0.0:1787781929.706922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.707022:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989056 00000100:00100000:3.0:1787781929.707035:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989056 00000100:00100000:3.0:1787781929.707108:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:3.0:1787781929.707120:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:10539:x1874624942989056:12345-192.168.206.16@tcp:101:rm.0 00010000:00010000:3.0:1787781929.707146:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781929.707171:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704000/0xc6d6745c15063556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83969 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781929.707300:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787781929.707487:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704000/0xc6d6745c15063556 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83969 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.707504:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:3.0:1787781929.707507:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781929.707512:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704000/0xc6d6745c15063556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83969 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.707541:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704000, rc 0) 00000100:00100000:3.0:1787781929.707664:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:10539:x1874624942989056:12345-192.168.206.16@tcp:101:rm.0 Request processed in 546us (755us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1787781929.707673:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:0.0:1787781929.727718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.729049:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989184 00000100:00100000:3.0:1787781929.729067:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989184 00000100:00100000:3.0:1787781929.729145:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:3.0:1787781929.729157:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:10539:x1874624942989184:12345-192.168.206.16@tcp:37:rm.0 00000100:00100000:2.0:1787781929.743123:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:10539:x1874624942989184:12345-192.168.206.16@tcp:37:rm.0 Request processed in 13953us (15404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781929.743142:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:0.0:1787781929.752020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781929.755037:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989440 00000100:00100000:1.0:1787781929.755056:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989440 00000100:00100000:1.0:1787781929.755208:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:1.0:1787781929.755221:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ea13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:10539:x1874624942989440:12345-192.168.206.16@tcp:35:rm.0 00000100:00100000:1.0:1787781929.755574:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ea13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:10539:x1874624942989440:12345-192.168.206.16@tcp:35:rm.0 Request processed in 355us (3566us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787781929.755583:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787781929.765576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.766136:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989696 00000100:00100000:2.0:1787781929.766148:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989696 00000100:00100000:2.0:1787781929.766429:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:2.0:1787781929.766442:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:10539:x1874624942989696:12345-192.168.206.16@tcp:101:rm.0 00010000:00010000:2.0:1787781929.766474:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781929.766502:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83970 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.766657:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506356b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.766676:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506356b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.766689:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506356b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781929.766702:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787781929.767034:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83970 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.767055:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506356b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83970 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.767073:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:2.0:1787781929.767077:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781929.767082:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781929.767209:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942989696:12345-192.168.206.16@tcp:101:rm.0 Request processed in 770us (1646us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787781929.767217:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:0.0:1787781929.778253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.778351:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989824 00000100:00100000:3.0:1787781929.778363:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989824 00000100:00100000:3.0:1787781929.778438:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:3.0:1787781929.778451:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942989824:12345-192.168.206.16@tcp:41:rm.0 00000004:00000024:3.0:1787781929.778516:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787781929.778797:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942989824:12345-192.168.206.16@tcp:41:rm.0 Request processed in 348us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.778806:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:0.0:1787781929.794844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781929.795025:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942989952 00000100:00100000:3.0:1787781929.795038:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942989952 00000100:00100000:3.0:1787781929.795109:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:3.0:1787781929.795119:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942989952:12345-192.168.206.16@tcp:101:rm.0 00010000:00010000:3.0:1787781929.795144:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781929.795168:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704000/0xc6d6745c15063579 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83977 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795249:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795292:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795307:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795320:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795328:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795335:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795451:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795460:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795467:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781929.795512:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787781929.795517:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781929.795538:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795553:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795572:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795579:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795586:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795593:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.795597:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795638:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795652:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:3.0:1787781929.795656:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.795661:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795667:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063580 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795682:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795687:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795693:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795704:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781929.795707:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795713:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795721:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee0b5fa0 (ffff993d6d095100) 00010000:00010000:3.0:1787781929.795723:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.795725:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795730:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795760:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704000/0xc6d6745c15063579 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83977 expref: 20 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795775:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83977 expref: 19 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.795781:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:3.0:1787781929.795784:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781929.795786:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705e00, rc 0) 00000100:00100000:3.0:1787781929.796053:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:10539:x1874624942989952:12345-192.168.206.16@tcp:101:rm.0 Request processed in 933us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.796062:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:1.0:1787781929.801331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781929.801456:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942990208 00000100:00100000:0.0:1787781929.801469:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942990208 00000100:00100000:0.0:1787781929.801535:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:0.0:1787781929.801547:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:10539:x1874624942990208:12345-192.168.206.16@tcp:36:rm.0 00010000:00010000:0.0:1787781929.801654:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787781929.801694:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c1506358e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83977 expref: 19 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801718:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506353a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8395b expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801730:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:0.0:1787781929.801740:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506354f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83962 expref: 17 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801747:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:0.0:1787781929.801751:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781929.801776:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801790:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801801:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801813:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801843:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801850:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.801992:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.802006:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.802014:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781929.807807:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787781929.807832:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366889224259ns, next at 367889219410ns, rc = 0 00010000:00010000:0.0:1787781929.807916:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807936:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807948:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807958:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807965:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807973:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.807995:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787781929.808019:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808026:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808060:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808067:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.808072:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808089:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808102:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:0.0:1787781929.808105:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787781929.808109:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808116:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8800/0xc6d6745c150635a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808136:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808144:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808152:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808157:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.808161:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.808165:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781929.808180:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.808198:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808199:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:3.0:1787781929.808213:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781929.808217:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781929.808221:0:10349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808224:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.808242:0:10349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808245:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063595 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781929.808295:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb357307 reply state 0000000008a9d4a6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.808296:0:10349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:3.0:1787781929.808307:0:10349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787781929.808315:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808319:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781929.808324:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c150635aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.808345:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee0b5fa0 (ffff993d6d095100) 00010000:00010000:0.0:1787781929.808351:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781929.808355:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787781929.808371:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781929.808375:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781929.808377:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781929.808449:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942990208:12345-192.168.206.16@tcp:36:rm.0 Request processed in 6901us (7128us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787781929.808957:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:0.0:1787781929.813317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.813413:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942990464 00000100:00100000:2.0:1787781929.813423:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942990464 00000100:00100000:2.0:1787781929.814251:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:2.0:1787781929.814280:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942990464:12345-192.168.206.16@tcp:35:rm.0 00000100:00100000:2.0:1787781929.815388:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:10539:x1874624942990464:12345-192.168.206.16@tcp:35:rm.0 Request processed in 1121us (2073us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787781929.815399:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:0.0:1787781929.826152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781929.827547:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942990720 00000100:00100000:2.0:1787781929.827574:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942990720 00000100:00100000:2.0:1787781929.827686:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:2.0:1787781929.827697:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:10539:x1874624942990720:12345-192.168.206.16@tcp:36:rm.0 00010000:00010000:2.0:1787781929.827758:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787781929.827790:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506356b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83970 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827815:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063509 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8394d expref: 18 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827827:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993d6d095400) 00010000:00010000:2.0:1787781929.827858:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d4150e600/0xc6d6745c150634ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8393f expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827869:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c42528e00) 00010000:00010000:2.0:1787781929.827874:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781929.827899:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827912:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827922:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827934:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827941:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.827948:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.828019:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.828027:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781929.828034:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781929.828691:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787781929.828720:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.828731:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.828756:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829084:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.829089:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829098:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829114:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff993c436a3800) 00010000:00010000:0.0:1787781929.829118:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787781929.829123:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829129:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150635bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829161:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829168:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829174:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829180:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781929.829182:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829199:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829209:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c436a3300) 00010000:00010000:0.0:1787781929.829211:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781929.829214:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829220:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150635b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781929.829235:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d03da785 reply state 00000000427d16b2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829247:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781929.829255:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993c436a3c00) 00010000:00010000:0.0:1787781929.829257:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781929.829261:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781929.829408:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:10539:x1874624942990720:12345-192.168.206.16@tcp:36:rm.0 Request processed in 1708us (3265us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787781929.829418:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00010000:00010000:1.0:1787781930.053842:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781930.504347:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787781930.504391:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962997760:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.504430:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962998144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.504669:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962997888:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.505892:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.506046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506100:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962998656:0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.506102:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962998272:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506158:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506192:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962999168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506324:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506361:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781930.506368:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962998784:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506396:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506442:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962998016:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506470:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506494:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962998528:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506517:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.506540:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962999040:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.506565:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781930.507599:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997760 00000100:00100000:0.0:1787781930.507699:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997760 00000100:00100000:0.0:1787781930.507765:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998784 00000100:00100000:0.0:1787781930.507769:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998784 00000100:00100000:0.0:1787781930.507852:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998016 00000100:00100000:0.0:1787781930.507856:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998016 00000100:00100000:0.0:1787781930.507872:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787781930.507880:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962997760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508055:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624962997760:12345-0@lo:400:kworker.0 Request processed in 174us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508062:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787781930.508079:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787781930.508085:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962998784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508121:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624962998784:12345-0@lo:400:kworker.0 Request processed in 36us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508127:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787781930.508152:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787781930.508158:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962998016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508194:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624962998016:12345-0@lo:400:kworker.0 Request processed in 35us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508199:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787781930.508312:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998656 00000100:00100000:0.0:1787781930.508317:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998656 00000100:00100000:0.0:1787781930.508344:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999168 00000100:00100000:0.0:1787781930.508348:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999168 00000100:00100000:0.0:1787781930.508363:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998528 00000100:00100000:0.0:1787781930.508366:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998528 00000100:00100000:0.0:1787781930.508379:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999040 00000100:00100000:0.0:1787781930.508382:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999040 00000100:00100000:0.0:1787781930.508399:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787781930.508406:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962998656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508447:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962998656:12345-0@lo:400:kworker.0 Request processed in 41us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508453:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787781930.508465:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787781930.508471:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962999168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508509:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962999168:12345-0@lo:400:kworker.0 Request processed in 32us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508515:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787781930.508530:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787781930.508536:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962998528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508566:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962998528:12345-0@lo:400:kworker.0 Request processed in 30us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508583:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787781930.508594:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787781930.508600:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962999040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.508725:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.508789:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962997504:0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.508858:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624962999040:12345-0@lo:400:kworker.0 Request processed in 255us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.508865:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787781930.508889:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998272 00000100:00100000:2.0:1787781930.509114:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.509151:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962997632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781930.509179:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.509232:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624962997760:0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.509280:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998144 00000100:00100000:2.0:1787781930.509286:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998144 00000100:00100000:2.0:1787781930.509327:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997632 00000100:00100000:2.0:1787781930.509330:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997632 00000100:00100000:2.0:1787781930.509349:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787781930.509356:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962998144:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787781930.509414:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781930.509421:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781930.509425:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781930.509483:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781930.509499:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962998400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.509521:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.509528:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962998144:12345-0@lo:400:kworker.0 Request processed in 171us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781930.509536:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787781930.509544:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998400 00000100:00100000:1.0:1787781930.509548:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998400 00000100:00100000:2.0:1787781930.509552:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997888 00000100:00100000:2.0:1787781930.509554:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997888 00000100:00100000:2.0:1787781930.509566:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787781930.509571:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3660:x1874624962997632:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781930.509575:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787781930.509581:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962998400:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1787781930.509600:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787781930.509628:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624962998400:12345-0@lo:400:kworker.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781930.509634:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:1.0:1787781930.509650:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781930.509660:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3660:x1874624962997632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781930.509666:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1787781930.509668:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e41a40 x1874624962998400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781930.509679:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624962998400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.509687:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962998912:0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.509689:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787781930.509695:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962997888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.509710:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781930.509722:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962997888:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781930.509726:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962998912 00000100:00100000:2.0:1787781930.509728:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787781930.509729:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998912 00000100:00100000:2.0:1787781930.509746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962997504 00000100:00100000:2.0:1787781930.509749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962997504 00000100:00100000:1.0:1787781930.509752:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787781930.509757:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962998912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.509772:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787781930.509777:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.509783:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624962998912:12345-0@lo:400:kworker.0 Request processed in 26us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781930.509804:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624962997504:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781930.509808:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1787781930.509824:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781930.510333:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962998272 00000100:00100000:0.0:1787781930.510412:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787781930.510420:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962998272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781930.510488:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624962998272:12345-0@lo:400:kworker.0 Request processed in 69us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781930.510495:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787781930.510544:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624962998016:0@lo:400:kworker.0 00010000:00080000:0.0:1787781930.510561:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e421c0 x1874624962998528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781930.510572:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962998528:0@lo:400:kworker.0 00010000:00080000:0.0:1787781930.510584:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4beaa940 x1874624962999040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781930.510592:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624962999040:0@lo:400:kworker.0 00010000:00080000:1.0:1787781930.510638:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bea8f00 x1874624962998912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781930.510653:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624962998912:0@lo:400:kworker.0 00000100:00080000:1.0:1787781930.510685:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781930.510709:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962997888:0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.510757:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624962998784:0@lo:400:kworker.0 00000100:00100000:1.0:1787781930.510770:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962998144:0@lo:400:kworker.0 00010000:00080000:1.0:1787781930.510784:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4bea9680 x1874624962998656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781930.510906:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787781930.511085:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624962998272:0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.511097:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624962997504:0@lo:400:kworker.0 00000100:00100000:2.0:1787781930.511115:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624962997632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781930.511331:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bea9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962998656:0@lo:400:kworker.0 00010000:00080000:2.0:1787781930.511634:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4beaad00 x1874624962999168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781930.511646:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4beaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962999168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.014314:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962999296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781931.014890:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781931.015072:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962999424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781931.015114:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781931.017711:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999424 00000100:00100000:0.0:1787781931.017711:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999296 00000100:00100000:2.0:1787781931.017731:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999424 00000100:00100000:0.0:1787781931.017732:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999296 00000100:00100000:2.0:1787781931.017816:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787781931.017825:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787781931.017830:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962999424:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781931.017838:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962999296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781931.017876:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787781931.017877:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781931.017978:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962999296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781931.017981:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962999424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.017988:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787781931.018000:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1787781931.018039:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43c6c000 x1874624962999424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781931.018062:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962999424:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787781931.018110:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fda940 x1874624962999296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781931.018124:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962999296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787781931.077828:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781931.403511:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781931.403724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942990848 00000100:00100000:0.0:1787781931.403738:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942990848 00000100:00100000:0.0:1787781931.403837:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 337 00000100:00100000:0.0:1787781931.403849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942990848:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781931.403940:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942990848:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 94us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.403948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 337 00000100:00100000:1.0:1787781931.404909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781931.405045:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781931.405078:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781931.405127:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991232 00000100:00100000:3.0:1787781931.405135:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991232 00000100:00100000:3.0:1787781931.405193:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 103 00000100:00100000:3.0:1787781931.405203:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942991232:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781931.405282:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942991232:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781931.405290:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 103 00000100:00100000:1.0:1787781931.405560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781931.405794:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942990976 00000100:00100000:0.0:1787781931.405800:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942990976 00000100:00100000:0.0:1787781931.405855:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991104 00000100:00100000:0.0:1787781931.405859:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991104 00000100:00100000:0.0:1787781931.405884:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 218 00000100:00100000:0.0:1787781931.405894:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2407:x1874624942990976:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781931.405940:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2407:x1874624942990976:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 48us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.405948:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 218 00000100:00100000:0.0:1787781931.405962:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 219 00000100:00100000:0.0:1787781931.405968:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942991104:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781931.406006:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942991104:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 38us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.406013:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 219 00000100:00100000:1.0:1787781931.406463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00080000:1.0:1787781931.406486:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781931.406490:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781931.406495:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781931.406514:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991488 00000100:00100000:1.0:1787781931.406520:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991488 00000100:00100000:1.0:1787781931.406552:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991360 00000100:00100000:1.0:1787781931.406555:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991360 00000100:00100000:1.0:1787781931.406570:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 220 00000100:00100000:1.0:1787781931.406576:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942991488:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781931.406645:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942991488:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 68us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781931.406653:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 220 00000100:00100000:1.0:1787781931.406668:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 221 00000100:00100000:1.0:1787781931.406675:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942991360:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781931.406704:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624942991360:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781931.406711:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 221 00000100:00080000:1.0:1787781931.406746:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781931.406749:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781931.528634:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781931.528665:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962999552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781931.528760:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787781931.529275:0:8636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368610666300ns, next at 369610663258ns, rc = 0 00000100:00100000:1.0:1787781931.529586:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781931.529604:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962999680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781931.529704:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781931.530644:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999552 00000100:00100000:3.0:1787781931.530657:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999552 00000100:00100000:3.0:1787781931.530723:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999680 00000100:00100000:3.0:1787781931.530736:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999680 00000100:00100000:3.0:1787781931.530756:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787781931.530765:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962999552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781931.530819:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781931.530894:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624962999552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781931.530902:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787781931.530921:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787781931.530928:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962999680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781931.530939:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781931.530971:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624962999680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781931.530977:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1787781931.531039:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43dd6580 x1874624962999680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781931.531062:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624962999680:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787781931.531392:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4a70c0 x1874624962999552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781931.531408:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624962999552:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787781932.105297:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781933.131273:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781933.574229:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781933.574272:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962999808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787781933.574362:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781933.574537:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999808 00000100:00100000:0.0:1787781933.574547:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999808 00000100:00100000:0.0:1787781933.574638:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787781933.574650:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962999808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781933.574691:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781933.574749:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624962999808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781933.574757:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787781933.575025:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624962999808:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787781933.829533:0:13694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787781934.151773:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787781935.118089:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787781935.118145:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787781935.118159:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787781935.118948:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781935.118974:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962999936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781935.119056:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781935.119301:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624962999936 00000100:00100000:2.0:1787781935.119312:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624962999936 00000100:00100000:2.0:1787781935.119386:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787781935.119396:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624962999936:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1787781935.119418:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787781935.119427:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1787781935.119468:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f6329, atime: 0x6a8f6329, ctime: 0x6a8f6329, blocks: 0x0 00010000:00010000:2.0:1787781935.119477:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.119495:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1787781935.119500:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781935.119509:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.119540:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.119550:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.119558:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.119582:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787781935.119932:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.119942:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.119950:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.119956:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781935.119959:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781935.119961:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.119970:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.119973:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.119992:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781935.119997:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120003:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee0b5fa0 (ffff993d6d095100) 00010000:00010000:1.0:1787781935.120008:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781935.120008:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120014:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120022:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c1506351e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120047:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120055:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.120062:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120082:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120088:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781935.120091:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120097:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120106:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff993c436a3900) 00010000:00010000:1.0:1787781935.120108:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781935.120111:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120116:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063533 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120135:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120153:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120159:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120164:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781935.120167:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120182:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.120189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0882f0e/0xc6d6745c150635c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120193:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xee0b5fa0 (ffff993d6d095100) 00010000:00010000:1.0:1787781935.120199:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781935.120204:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120212:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506359c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xee0b5fa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.120222:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781935.120227:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781935.120230:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781935.120243:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120251:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120257:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120262:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781935.120264:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120270:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120277:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff993c436a3c00) 00010000:00010000:1.0:1787781935.120280:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781935.120282:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.120295:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c150635b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.122064:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624962999936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2660us (2998us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787781935.122079:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1787781935.122213:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43e421c0/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787781935.122221:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624962999936:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787781935.175571:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787781935.204577:0:13742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd96939b40 20000000:00000080:3.0:1787781935.204984:0:13742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993c41d15800 uarg=0000000000000000 20000000:01000000:3.0:1787781935.205030:0:13742:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787781935.205038:0:13742:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787781935.205043:0:13742:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787781935.206362:0:13743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787781935.206583:0:13742:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787781935.211741:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787781935.211773:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787781935.211874:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787781935.211893:0:13742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787781935.212048:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212068:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212076:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212101:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063461 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212108:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506346f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212114:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506347d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212121:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506348b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212129:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212255:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212268:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 23 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212282:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000064:0@lo:104: 00000100:00100000:2.0:1787781935.212411:0:13742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781935.212589:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212598:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 23 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212639:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000192:0@lo:104: 00010000:00010000:2.0:1787781935.212683:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212692:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 23 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212701:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000320:0@lo:104: 00010000:00010000:2.0:1787781935.212719:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212727:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 23 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212734:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000448:0@lo:104: 00010000:00010000:2.0:1787781935.212753:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212763:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 12 pid: 6523 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212771:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000576:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781935.212878:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787781935.212951:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.212960:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 12 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.212968:0:13742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000704:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781935.213043:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.213081:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.213096:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.213111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000064 00000100:00100000:0.0:1787781935.213117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000064 00000100:00100000:0.0:1787781935.213179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000192 00000100:00100000:0.0:1787781935.213183:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000192 00000100:00100000:0.0:1787781935.213200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000320 00000100:00100000:0.0:1787781935.213204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000320 00000100:00100000:0.0:1787781935.213215:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000448 00000100:00100000:0.0:1787781935.213218:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000448 00000100:00100000:0.0:1787781935.213230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781935.213248:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c426f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:13742:x1874624963000064:12345-0@lo:104: 00010000:00010000:0.0:1787781935.213261:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213328:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781935.213334:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c426f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+6:13742:x1874624963000064:12345-0@lo:104: Request processed in 88us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.213350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781935.213390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781935.213396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:13742:x1874624963000192:12345-0@lo:104: 00010000:00010000:0.0:1787781935.213404:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213451:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781935.213456:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+5:13742:x1874624963000192:12345-0@lo:104: Request processed in 61us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.213462:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781935.213474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781935.213480:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:13742:x1874624963000320:12345-0@lo:104: 00010000:00010000:0.0:1787781935.213488:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213524:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787781935.213529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+4:13742:x1874624963000320:12345-0@lo:104: Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.213535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781935.213547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787781935.213553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13742:x1874624963000448:12345-0@lo:104: 00010000:00010000:0.0:1787781935.213560:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213595:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787781935.213599:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+3:13742:x1874624963000448:12345-0@lo:104: Request processed in 47us (503us total) trans 0 rc 0/0 00010000:00010000:3.0:1787781935.213602:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787781935.213624:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.213627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787781935.213642:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d4150f200 already unused, calling callback (ffffffffc121fc20) 00010000:00010000:0.0:1787781935.213643:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:3.0:1787781935.213646:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213647:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213653:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704c00 already unused, calling callback (ffffffffc121fc20) 00010000:00010000:3.0:1787781935.213655:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781935.213656:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781935.213663:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213664:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781935.213669:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1787781935.213671:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781935.213675:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781935.213735:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781935.213756:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213759:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.213791:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc121fc20) 00010000:00010000:0.0:1787781935.213791:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1787781935.213801:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.213815:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781935.213824:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213826:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781935.213853:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787781935.213859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506347d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063484 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213879:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781935.213883:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213902:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9800 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787781935.213905:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213912:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.213917:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781935.213920:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.213936:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1787781935.213943:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787781935.213972:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.213975:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.213995:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781935.214005:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9400/0xc6d6745c1506346f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063476 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.214012:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.214029:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9800/0xc6d6745c15063461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063468 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.214049:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781935.214053:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781935.214059:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781935.214070:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781935.214073:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787781935.214075:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781935.214083:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781935.214094:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781935.214099:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963000960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781935.214145:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963001088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.214146:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.214148:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781935.214163:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781935.214178:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.214184:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d4150f200/0xc6d6745c1506348b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15063492 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.214200:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963000832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781935.214284:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781935.214320:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781935.214328:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963001216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.214344:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781935.214350:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781935.214355:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781935.214361:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781935.214403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000960 00000100:00100000:1.0:1787781935.214415:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000960 00000100:00100000:3.0:1787781935.214499:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001088 00000100:00100000:3.0:1787781935.214506:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001088 00010000:00010000:3.0:1787781935.214588:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 25 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781935.214644:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001216 00000100:00100000:3.0:1787781935.214655:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001216 00010000:00010000:3.0:1787781935.214670:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781935.214684:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787781935.214755:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3659:x1874624963001088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.214768:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787781935.214781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781935.214834:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.214846:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.214862:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781935.214963:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3659:x1874624963001088:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.214970:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787781935.214984:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963000832 00000100:00100000:3.0:1787781935.214987:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963000832 00010000:00010000:3.0:1787781935.214998:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781935.215011:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787781935.215016:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3659:x1874624963001216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.215023:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781935.215027:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.215034:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.215065:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781935.215170:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 26 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781935.215214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787781935.215221:0:13742:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781935.215243:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+26:3657:x1874624963000832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781935.215261:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787781935.215270:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000064:0@lo:104: 00010000:00010000:1.0:1787781935.215276:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.215287:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000192:0@lo:104: 00010000:00010000:1.0:1787781935.215299:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.215305:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039400/0xc6d6745c15063476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506346f expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.215330:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705000/0xc6d6745c15063492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506348b expref: 26 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.215386:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000320:0@lo:104: 00010000:00010000:2.0:1787781935.215399:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705c00/0xc6d6745c15063468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15063461 expref: 24 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.215407:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000448:0@lo:104: 00000100:00100000:0.0:1787781935.215506:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963001088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781935.215554:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3659:x1874624963001216:12345-0@lo:103:ldlm_bl.0 Request processed in 536us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.215560:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963001216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781935.215562:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787781935.215578:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787781935.215586:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3657:x1874624963000960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.215597:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781935.215602:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 22 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.215639:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 22 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.215651:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e400/0xc6d6745c15063484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506347d expref: 22 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.215660:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781935.215691:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3657:x1874624963000960:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.215696:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787781935.215749:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963000960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781935.215928:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781935.215997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3657:x1874624963000832:12345-0@lo:103:ldlm_bl.0 Request processed in 770us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781935.216019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787781935.216062:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963000832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781935.229566:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000576:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781935.238316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781935.238395:0:13742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1874624963000704:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781935.238430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781935.238489:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991616 00000100:00100000:3.0:1787781935.238497:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991616 00000100:00100000:0.0:1787781935.238520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991744 00000100:00100000:0.0:1787781935.238526:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991744 00010000:00010000:3.0:1787781935.238539:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 14 pid: 6523 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.238551:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 14 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781935.238583:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:3.0:1787781935.238596:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+14:2408:x1874624942991616:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781935.238672:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781935.238681:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 14 pid: 6523 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.238693:0:13742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.238694:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 14 pid: 6523 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.244786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:0.0:1787781935.244811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+14:2408:x1874624942991744:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781935.244842:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781935.244853:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 14 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.244869:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 14 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.244888:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9a00/0xc6d6745c15063453 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8392a expref: 14 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.244903:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781935.244969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624942991744:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 170us (6542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.244977:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 51 00010000:00010000:3.0:1787781935.246094:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704a00/0xc6d6745c1506345a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83931 expref: 12 pid: 6523 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246113:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246122:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246141:0:9533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246148:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246155:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246162:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246542:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781935.246547:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246570:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246587:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.246600:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781935.246656:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:2408:x1874624942991616:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 8062us (8354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.246665:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 50 00010000:00010000:3.0:1787781935.247886:0:13742:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.247899:0:13742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.247905:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e5600/0xc6d6745c150635cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.626748:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963001728:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.626829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.626884:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963002240:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.626910:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.626933:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963002752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781935.626957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.626981:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787781935.626987:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963001344:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627008:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627023:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963001856:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627039:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627053:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963002368:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627069:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627094:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963001472:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627114:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627130:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963001984:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627147:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627156:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963002496:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627193:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627214:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787781935.627221:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963001600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627253:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627264:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963002112:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627281:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627306:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963002624:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627326:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781935.627351:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001728 00000100:00100000:0.0:1787781935.627357:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001728 00000100:00100000:0.0:1787781935.627389:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002752 00000100:00100000:0.0:1787781935.627392:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002752 00000100:00100000:0.0:1787781935.627402:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001472 00000100:00100000:0.0:1787781935.627405:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001472 00000100:00100000:0.0:1787781935.627416:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787781935.627423:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963001728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627477:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963001728:12345-0@lo:400:kworker.0 Request processed in 53us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627484:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787781935.627498:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787781935.627504:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963002752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787781935.627529:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781935.627560:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963002752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627566:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787781935.627577:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787781935.627583:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963001472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627643:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963001472:12345-0@lo:400:kworker.0 Request processed in 59us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627648:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787781935.627667:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002240 00000100:00100000:0.0:1787781935.627670:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002240 00000100:00100000:0.0:1787781935.627696:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001344 00000100:00100000:0.0:1787781935.627700:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001344 00000100:00100000:0.0:1787781935.627717:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001856 00000100:00100000:0.0:1787781935.627719:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001856 00000100:00100000:0.0:1787781935.627729:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002368 00000100:00100000:0.0:1787781935.627731:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002368 00000100:00100000:0.0:1787781935.627742:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001984 00000100:00100000:0.0:1787781935.627745:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001984 00000100:00100000:0.0:1787781935.627756:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963001600 00000100:00100000:0.0:1787781935.627758:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963001600 00000100:00100000:0.0:1787781935.627769:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787781935.627775:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963002240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627819:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963002240:12345-0@lo:400:kworker.0 Request processed in 43us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627824:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787781935.627836:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787781935.627842:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963001344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627868:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963001344:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627873:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787781935.627883:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787781935.627889:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963001856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627913:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963001856:12345-0@lo:400:kworker.0 Request processed in 24us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627918:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787781935.627927:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787781935.627933:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963002368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.627957:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963002368:12345-0@lo:400:kworker.0 Request processed in 24us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.627972:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787781935.627984:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787781935.627989:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963001984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628014:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963001984:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.628019:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787781935.628028:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787781935.628033:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963001600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628056:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963001600:12345-0@lo:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.628061:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787781935.628086:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002496 00000100:00100000:0.0:1787781935.628089:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002496 00000100:00100000:0.0:1787781935.628116:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002112 00000100:00100000:0.0:1787781935.628119:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002112 00000100:00100000:0.0:1787781935.628134:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002624 00000100:00100000:0.0:1787781935.628137:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002624 00000100:00100000:0.0:1787781935.628150:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787781935.628155:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963002496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628183:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963002496:12345-0@lo:400:kworker.0 Request processed in 28us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.628189:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787781935.628199:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787781935.628205:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963002112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628230:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963002112:12345-0@lo:400:kworker.0 Request processed in 25us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.628258:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787781935.628269:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787781935.628274:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963002624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628301:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963002624:12345-0@lo:400:kworker.0 Request processed in 27us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.628306:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1787781935.628324:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781935.628328:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781935.628330:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781935.628332:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781935.628365:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963001600:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628379:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963002112:0@lo:400:kworker.0 00010000:00080000:0.0:1787781935.628390:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d461c0 x1874624963002624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781935.628400:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963002624:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628410:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963001472:0@lo:400:kworker.0 00010000:00080000:0.0:1787781935.628419:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d47480 x1874624963001984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781935.628427:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963001984:0@lo:400:kworker.0 00010000:00080000:0.0:1787781935.628436:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d44b40 x1874624963002496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781935.628444:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963002496:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628484:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963001344:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628503:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963001856:0@lo:400:kworker.0 00010000:00080000:0.0:1787781935.628514:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d46580 x1874624963002368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781935.628522:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963002368:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628533:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963001728:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628543:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963002240:0@lo:400:kworker.0 00000100:00100000:0.0:1787781935.628556:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963002752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781936.133863:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781936.133891:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963002880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781936.133905:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963003008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781936.138705:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781936.138810:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781936.141969:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963002880 00000100:00100000:1.0:1787781936.142021:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963002880 00000100:00100000:1.0:1787781936.142152:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003008 00000100:00100000:1.0:1787781936.142157:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003008 00000100:00100000:2.0:1787781936.142390:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787781936.142403:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963002880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781936.142438:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781936.142520:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963002880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.142527:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787781936.142549:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787781936.142557:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963003008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787781936.142585:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781936.142640:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963003008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.142647:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1787781936.142687:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67d412c0 x1874624963002880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781936.142706:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963002880:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787781936.144152:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d452c0 x1874624963003008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781936.144183:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963003008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787781936.199268:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787781936.353974:0:13791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff442a0170 20000000:00000080:3.0:1787781936.353991:0:13791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993c43757800 uarg=0000000000000000 20000000:01000000:3.0:1787781936.354033:0:13791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787781936.354040:0:13791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787781936.354044:0:13791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1787781936.354948:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787781936.355109:0:13791:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787781936.355182:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787781936.355363:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787781936.355456:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787781936.355473:0:13791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787781936.355494:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355512:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355523:0:13791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355530:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355537:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355544:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355550:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781936.355553:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355561:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355573:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355581:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781936.355599:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704a00/0xc6d6745c150635d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781936.455903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781936.457902:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942991872 00000100:00100000:1.0:1787781936.457916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942991872 00000100:00100000:1.0:1787781936.457973:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 338 00000100:00100000:1.0:1787781936.457983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:6192:x1874624942991872:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781936.457998:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781936.458017:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039400/0xc6d6745c150635db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8397e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781936.458044:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039400/0xc6d6745c150635db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8397e expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781936.458055:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039400/0xc6d6745c150635db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8397e expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781936.458063:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039400, rc 0) 00000100:00100000:1.0:1787781936.458161:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942991872:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 180us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781936.458169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 338 00000100:00100000:2.0:1787781936.461512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.461599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992000 00000100:00100000:3.0:1787781936.461682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992000 00000100:00100000:2.0:1787781936.461794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 339 00000100:00100000:2.0:1787781936.461803:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942992000:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781936.461945:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942992000:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 143us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.461953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 339 00000100:00100000:0.0:1787781936.464744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.464871:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992128 00000100:00100000:3.0:1787781936.464880:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992128 00000100:00100000:3.0:1787781936.464932:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 340 00000100:00100000:3.0:1787781936.464942:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942992128:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781936.465057:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942992128:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.465065:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 340 00000100:00100000:1.0:1787781936.473491:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781936.473679:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992256 00000100:00100000:0.0:1787781936.473688:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992256 00000100:00100000:0.0:1787781936.473738:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 341 00000100:00100000:0.0:1787781936.473748:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:10824:x1874624942992256:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781936.473897:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:10824:x1874624942992256:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 149us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781936.473908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 341 00000100:00100000:0.0:1787781936.477037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.477122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992384 00000100:00100000:3.0:1787781936.477131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992384 00000100:00100000:3.0:1787781936.477182:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 342 00000100:00100000:3.0:1787781936.477191:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:10824:x1874624942992384:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781936.477327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:10824:x1874624942992384:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.477335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 342 00000100:00100000:2.0:1787781936.489187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781936.489423:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992512 00000100:00100000:0.0:1787781936.489433:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992512 00000100:00100000:0.0:1787781936.489487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 343 00000100:00100000:0.0:1787781936.489497:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:6192:x1874624942992512:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781936.489513:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781936.489529:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8800/0xc6d6745c150635e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83985 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781936.489557:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8800/0xc6d6745c150635e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83985 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781936.489569:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8800/0xc6d6745c150635e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83985 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781936.489578:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8800, rc 0) 00000100:00100000:0.0:1787781936.489655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942992512:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 159us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781936.489662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 343 00000100:00100000:0.0:1787781936.495860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.495961:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992640 00000100:00100000:3.0:1787781936.495971:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992640 00000100:00100000:3.0:1787781936.496021:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 344 00000100:00100000:3.0:1787781936.496030:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942992640:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781936.496163:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942992640:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 134us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.496185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 344 00000100:00100000:2.0:1787781936.501513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.501579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992768 00000100:00100000:3.0:1787781936.501589:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992768 00000100:00100000:3.0:1787781936.501653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 345 00000100:00100000:3.0:1787781936.501661:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942992768:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781936.501806:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:6192:x1874624942992768:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 144us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.501814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 345 00000100:00100000:1.0:1787781936.506524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.506627:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942992896 00000100:00100000:3.0:1787781936.506638:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942992896 00000100:00100000:3.0:1787781936.506687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 346 00000100:00100000:3.0:1787781936.506697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:10827:x1874624942992896:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781936.506830:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:10827:x1874624942992896:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 134us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.506837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 346 00000100:00100000:1.0:1787781936.512430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781936.512538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993024 00000100:00100000:3.0:1787781936.512548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993024 00000100:00100000:3.0:1787781936.512603:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 347 00000100:00100000:3.0:1787781936.512666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:10827:x1874624942993024:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781936.512807:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:10827:x1874624942993024:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.512815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 347 00000100:00100000:2.0:1787781936.524798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781936.524830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781936.524851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781936.524868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781936.524926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781936.524959:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993408 00000100:00100000:2.0:1787781936.524968:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993408 00000100:00100000:2.0:1787781936.525026:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 107 00000100:00100000:2.0:1787781936.525035:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993408:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781936.525177:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993408:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 142us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.525199:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 107 00000100:00100000:2.0:1787781936.525224:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993152 00000100:00100000:2.0:1787781936.525239:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993152 00000100:00100000:2.0:1787781936.525262:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993664 00000100:00100000:2.0:1787781936.525264:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993664 00000100:00100000:3.0:1787781936.525385:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993280 00000100:00100000:3.0:1787781936.525389:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993280 00000100:00100000:3.0:1787781936.525419:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993536 00000100:00100000:3.0:1787781936.525422:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993536 00000100:00100000:3.0:1787781936.525435:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 228 00000100:00100000:3.0:1787781936.525441:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993152:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781936.525472:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993152:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.525478:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 228 00000100:00100000:3.0:1787781936.525491:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 229 00000100:00100000:3.0:1787781936.525497:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993280:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781936.525520:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993280:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.525527:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 229 00000100:00100000:3.0:1787781936.525542:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 230 00000100:00100000:3.0:1787781936.525547:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942993536:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781936.525660:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942993536:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 34us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.525667:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 230 00000100:00100000:2.0:1787781936.526195:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 231 00000100:00100000:2.0:1787781936.526204:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942993664:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781936.526250:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942993664:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 48us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.526256:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 231 00000100:00080000:2.0:1787781936.526350:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781936.526355:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781936.526358:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781936.646027:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781936.646050:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781936.646120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781936.646279:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003136 00000100:00100000:1.0:1787781936.646287:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003136 00000100:00100000:1.0:1787781936.646341:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787781936.646351:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963003136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781936.646380:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781936.646578:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963003136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781936.646587:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787781936.646710:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781936.647492:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963003264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781936.647538:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781936.647674:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003264 00000100:00100000:3.0:1787781936.647680:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003264 00000100:00100000:3.0:1787781936.647725:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787781936.647734:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963003264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781936.647765:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781936.647927:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963003264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 194us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.647935:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787781936.648005:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963003264:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787781937.222586:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787781937.222593:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7c44e000 from 7 10000000:01000000:1.0:1787781937.222599:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787781937.222685:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.222698:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.222710:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781937.222736:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.222812:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.222886:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781937.222932:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003392 00000100:00100000:3.0:1787781937.222945:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003392 00000100:00100000:3.0:1787781937.223017:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787781937.223027:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:6528:x1874624963003392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781937.223056:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781937.223078:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704a00/0xc6d6745c150635f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150635e9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.223114:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704a00/0xc6d6745c150635f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150635e9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.223127:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704a00/0xc6d6745c150635f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150635e9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.223137:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704a00, rc 0) 00000100:00100000:3.0:1787781937.223234:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963003392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781937.223247:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:2.0:1787781937.223284:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781937.223456:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781937.223477:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.223487:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781937.223595:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.223659:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.223696:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781937.223941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003520 00000100:00100000:3.0:1787781937.223947:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003520 00000100:00100000:3.0:1787781937.224055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787781937.224065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963003520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781937.224205:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963003520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781937.224234:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787781937.224305:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.224342:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.224385:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.233018:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781937.233900:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003648 00000100:00100000:0.0:1787781937.233915:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003648 00000100:00100000:0.0:1787781937.233982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787781937.233992:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963003648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781937.234314:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963003648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (9927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781937.234331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787781937.234463:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963003648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.234950:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13804:1874624963003776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.235002:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.235034:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781937.235152:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003776 00000100:00100000:0.0:1787781937.235157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003776 00000100:00100000:0.0:1787781937.235180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787781937.235187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:13804:x1874624963003776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781937.235330:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:13804:x1874624963003776:12345-0@lo:502:llog_process_th.0 Request processed in 142us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781937.235338:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787781937.235928:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13804:1874624963003776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781937.235963:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.235976:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.235980:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.235989:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d7c44e000 00000020:00000080:1.0:1787781937.235992:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787781937.236178:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781937.236183:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.236184:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.236187:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.236190:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.236192:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787781937.236195:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d7c44e000 00000020:00000080:1.0:1787781937.236197:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787781937.246105:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13804:1874624963003904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.246236:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.246308:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.246400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963003904 00000100:00100000:1.0:1787781937.246410:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963003904 00000100:00100000:1.0:1787781937.246490:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787781937.246502:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:13804:x1874624963003904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.246756:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:13804:x1874624963003904:12345-0@lo:502:llog_process_th.0 Request processed in 254us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.246765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787781937.247067:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13804:1874624963003904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781937.247101:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781937.247111:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.247113:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787781937.247119:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787781937.247296:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787781937.247320:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787781937.247332:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.247343:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781937.247355:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787781937.247359:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d7236f800 from 7 10000000:01000000:1.0:1787781937.247362:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787781937.247395:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.247416:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.247427:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781937.247445:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.247505:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.247534:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781937.247540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004032 00000100:00100000:2.0:1787781937.247547:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004032 00000100:00100000:2.0:1787781937.247593:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787781937.247625:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:6528:x1874624963004032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781937.247646:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781937.247669:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e5e00/0xc6d6745c150635fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150635f7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.247705:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e5e00/0xc6d6745c150635fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150635f7 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.247717:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e5e00/0xc6d6745c150635fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150635f7 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.247752:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5e00, rc 0) 00000100:00100000:2.0:1787781937.247810:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781937.247838:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787781937.247968:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781937.247984:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.247995:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781937.248048:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.248191:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.248218:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.248245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004160 00000100:00100000:1.0:1787781937.248249:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004160 00000100:00100000:1.0:1787781937.249023:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787781937.249035:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.249346:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.249355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787781937.249413:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.249460:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.249506:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.249533:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.249547:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004288 00000100:00100000:1.0:1787781937.249552:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004288 00000100:00100000:1.0:1787781937.249573:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787781937.249580:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.249681:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.249689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787781937.249731:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.250027:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13807:1874624963004416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.250134:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.250161:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781937.250268:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004416 00000100:00100000:2.0:1787781937.250273:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004416 00000100:00100000:2.0:1787781937.250311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787781937.250319:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:13807:x1874624963004416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781937.250431:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:13807:x1874624963004416:12345-0@lo:502:llog_process_th.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781937.250438:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787781937.250763:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13807:1874624963004416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781937.250931:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.250943:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.250946:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.250953:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d7236f800 00000020:00000080:1.0:1787781937.250956:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787781937.251027:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781937.251031:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.251032:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.251036:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.251038:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.251969:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787781937.251982:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d7236f800 00000020:00000080:1.0:1787781937.251985:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787781937.252688:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13807:1874624963004544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.252803:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.252858:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781937.252991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004544 00000100:00100000:3.0:1787781937.253000:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004544 00000100:00100000:3.0:1787781937.253069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787781937.253080:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:13807:x1874624963004544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781937.253233:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:13807:x1874624963004544:12345-0@lo:502:llog_process_th.0 Request processed in 144us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781937.253242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787781937.253412:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13807:1874624963004544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781937.253445:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781937.253453:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.253455:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787781937.253459:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787781937.253703:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787781937.253735:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781937.253747:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.253763:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781937.255694:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781937.255709:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d80a11800 from 7 10000000:01000000:3.0:1787781937.255715:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781937.255799:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.255818:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781937.255832:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781937.255866:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781937.255956:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781937.257185:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d47c660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.258192:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004672 00000100:00100000:1.0:1787781937.258214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004672 00000100:00100000:1.0:1787781937.258299:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787781937.258310:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:6528:x1874624963004672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781937.258340:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781937.258367:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039200/0xc6d6745c1506360c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063605 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.258400:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039200/0xc6d6745c1506360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063605 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.258413:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039200/0xc6d6745c1506360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063605 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.258423:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039200, rc 0) 00000100:00100000:1.0:1787781937.258508:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963004672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.258516:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787781937.258597:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781937.258634:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.258645:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781937.258729:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.258763:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.258783:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d588259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.258797:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004800 00000100:00100000:1.0:1787781937.258800:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004800 00000100:00100000:1.0:1787781937.258822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787781937.258829:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963004800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.258950:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963004800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.258957:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787781937.258985:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.259012:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.259887:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781937.259914:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d588259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.259935:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963004928 00000100:00100000:1.0:1787781937.259941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963004928 00000100:00100000:1.0:1787781937.259971:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787781937.259979:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963004928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781937.260302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963004928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.260317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000040:00080000:1.0:1787781937.262920:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787781937.265199:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781937.266754:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13809:1874624963005056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781937.266867:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781937.266919:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d42d9c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787781937.267539:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005056 00000100:00100000:3.0:1787781937.267551:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005056 00000100:00100000:3.0:1787781937.274272:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787781937.274296:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:13809:x1874624963005056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781937.274513:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:13809:x1874624963005056:12345-0@lo:502:llog_process_th.0 Request processed in 226us (7645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781937.274522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787781937.274686:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13809:1874624963005056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781937.274732:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781937.274744:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781937.274746:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787781937.274761:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d80a11800 00000020:00000080:0.0:1787781937.274764:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787781937.274840:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781937.274844:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781937.274845:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787781937.274849:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781937.274851:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781937.274853:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787781937.274857:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d80a11800 00000020:00000080:0.0:1787781937.274859:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787781937.274915:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13809:1874624963005184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781937.274969:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781937.278315:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.279253:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005184 00000100:00100000:1.0:1787781937.279267:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005184 00000100:00100000:1.0:1787781937.279328:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787781937.279339:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:13809:x1874624963005184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.279522:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:13809:x1874624963005184:12345-0@lo:502:llog_process_th.0 Request processed in 185us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.279530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787781937.281215:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13809:1874624963005184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781937.281278:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781937.281294:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781937.281297:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787781937.281308:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787781937.281483:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787781937.281512:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781937.281527:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.281540:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781937.281551:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787781937.281554:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d47267800 from 7 10000000:01000000:2.0:1787781937.281557:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781937.281597:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.281643:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781937.281654:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781937.281679:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781937.281756:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781937.281810:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d42d9c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.281984:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005312 00000100:00100000:1.0:1787781937.281992:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005312 00000100:00100000:1.0:1787781937.282182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787781937.282194:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:6528:x1874624963005312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781937.282210:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781937.282234:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43039000/0xc6d6745c1506361a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15063613 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.282261:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43039000/0xc6d6745c1506361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15063613 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.282273:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43039000/0xc6d6745c1506361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15063613 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781937.282284:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039000, rc 0) 00000100:00100000:1.0:1787781937.282342:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624963005312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.282348:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787781937.282435:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781937.282450:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781937.282459:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781937.282534:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781937.282567:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781937.282602:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781937.282687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005440 00000100:00100000:2.0:1787781937.282692:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005440 00000100:00100000:2.0:1787781937.283871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787781937.283887:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624963005440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781937.284075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624963005440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781937.284083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000040:00080000:3.0:1787781937.284681:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787781937.287759:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781937.287906:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781937.288008:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781937.288211:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781937.288760:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005568 00000100:00100000:2.0:1787781937.288771:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005568 00000100:00100000:2.0:1787781937.289235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787781937.289247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624963005568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781937.289409:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:6528:x1874624963005568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781937.289418:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787781937.289480:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2f49034a-383c-4a58-b5dc-1e0e9271edf7:6528:1874624963005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781937.289760:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13812:1874624963005696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781937.290346:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781937.290421:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d42d9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781937.295364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005696 00000100:00100000:3.0:1787781937.295384:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005696 00000100:00100000:2.0:1787781937.296194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787781937.296460:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:13812:x1874624963005696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781937.296736:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:13812:x1874624963005696:12345-0@lo:502:llog_process_th.0 Request processed in 530us (6391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781937.296745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787781937.298583:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d44b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13812:1874624963005696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781937.298658:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.298671:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.298673:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.298682:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d47267800 00000020:00000080:1.0:1787781937.298685:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787781937.298755:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781937.298759:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.298760:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781937.298763:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781937.298765:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781937.298767:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787781937.298771:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d47267800 00000020:00000080:3.0:1787781937.300134:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787781937.300286:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13812:1874624963005824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781937.300384:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781937.300430:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781937.300764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005824 00000100:00100000:1.0:1787781937.300845:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005824 00000100:00100000:1.0:1787781937.300903:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787781937.300914:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:13812:x1874624963005824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781937.301972:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5ebec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:13812:x1874624963005824:12345-0@lo:502:llog_process_th.0 Request processed in 1054us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781937.301983:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787781937.302267:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2f49034a-383c-4a58-b5dc-1e0e9271edf7:13812:1874624963005824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781937.302308:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781937.302317:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781937.302320:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787781937.302333:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787781937.302564:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787781937.302596:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781937.302636:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781937.302649:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781938.245956:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781938.310553:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787781938.310568:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787781938.694016:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963005952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781938.694111:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781938.694279:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963005952 00000100:00100000:1.0:1787781938.694289:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963005952 00000100:00100000:1.0:1787781938.694351:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787781938.694363:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963005952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781938.694404:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781938.694467:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963005952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781938.694504:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781938.695940:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963005952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781939.269984:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781940.294493:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781940.742005:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963006464:0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.742098:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.742277:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963006080:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.742551:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963006208:0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.743435:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963006336:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.745724:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.745819:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963006592:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.745887:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.745911:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963007104:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.746106:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.746153:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963007616:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.746179:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.746223:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781940.746231:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963007744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781940.746255:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.746303:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006464 00000100:00100000:2.0:1787781940.746312:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006464 00000100:00100000:2.0:1787781940.746372:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787781940.746382:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963006464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.746445:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963006464:12345-0@lo:400:kworker.0 Request processed in 64us (4347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.746453:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787781940.746655:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006080 00000100:00100000:2.0:1787781940.746660:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006080 00000100:00100000:2.0:1787781940.746697:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787781940.746705:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624963006080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.746746:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624963006080:12345-0@lo:400:kworker.0 Request processed in 42us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.746752:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787781940.746783:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006592 00000100:00100000:2.0:1787781940.746787:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006592 00000100:00100000:2.0:1787781940.746811:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007744 00000100:00100000:2.0:1787781940.746814:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007744 00000100:00100000:2.0:1787781940.746827:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787781940.746833:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963006592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.747175:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963006592:12345-0@lo:400:kworker.0 Request processed in 277us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.747183:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787781940.747199:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787781940.747216:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963007744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781940.747246:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781940.747283:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963007744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.747290:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787781940.747313:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007104 00000100:00100000:2.0:1787781940.747317:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007104 00000100:00100000:2.0:1787781940.747351:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007616 00000100:00100000:2.0:1787781940.747354:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007616 00000100:00100000:2.0:1787781940.747373:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787781940.747378:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.747422:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963007104:12345-0@lo:400:kworker.0 Request processed in 43us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.747429:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787781940.747443:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787781940.747449:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963007616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.748290:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963007616:12345-0@lo:400:kworker.0 Request processed in 30us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.748301:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1787781940.748352:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781940.748357:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781940.748419:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963007744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781940.748435:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963006080:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.748448:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963006592:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.748463:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963007104:0@lo:400:kworker.0 00010000:00080000:2.0:1787781940.748492:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0ead00 x1874624963007616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781940.748504:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963007616:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.749779:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781940.749833:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963006720:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.749889:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781940.749923:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963007232:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.749959:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781940.749994:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006208 00000100:00100000:0.0:1787781940.750004:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006208 00000100:00100000:0.0:1787781940.750058:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006720 00000100:00100000:0.0:1787781940.750062:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006720 00000100:00100000:0.0:1787781940.750089:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007232 00000100:00100000:0.0:1787781940.750092:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007232 00000100:00100000:0.0:1787781940.750121:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787781940.750131:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963006208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.750187:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963006208:12345-0@lo:400:kworker.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781940.750194:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787781940.750224:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787781940.750231:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.750261:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963006720:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781940.750268:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787781940.750279:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787781940.750285:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.750311:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963007232:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781940.750317:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1787781940.750338:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781940.750370:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963007232:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.750399:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963006208:0@lo:400:kworker.0 00000100:00100000:0.0:1787781940.750420:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963006720:0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.756773:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963006464:0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.756795:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963006976:0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.756896:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781940.757070:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006976 00000100:00100000:0.0:1787781940.757078:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006976 00000100:00100000:0.0:1787781940.757170:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787781940.757181:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.757267:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963007488:0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.757294:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781940.757321:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007488 00000100:00100000:1.0:1787781940.757324:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007488 00000100:00100000:1.0:1787781940.757361:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787781940.757367:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963007488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781940.757405:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963007488:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781940.757413:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1787781940.757473:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0e8780 x1874624963007488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781940.757486:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963007488:0@lo:400:kworker.0 00000100:00080000:1.0:1787781940.757544:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781940.757549:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781940.765423:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963006976:12345-0@lo:400:kworker.0 Request processed in 8229us (8512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781940.765444:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787781940.768992:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963006976:0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.771523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781940.771603:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963006848:0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.771675:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781940.771716:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963007360:0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.771740:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781940.771810:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006848 00000100:00100000:3.0:1787781940.771820:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006848 00000100:00100000:3.0:1787781940.771903:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007360 00000100:00100000:3.0:1787781940.771907:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007360 00000100:00100000:3.0:1787781940.771938:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787781940.771948:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963006848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.772014:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963006848:12345-0@lo:400:kworker.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781940.772022:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787781940.772044:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787781940.772050:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963007360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781940.772076:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963007360:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781940.772081:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1787781940.772102:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787781940.772143:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0e8b40 x1874624963007360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781940.772175:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963007360:0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.772519:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963006336 00000100:00100000:2.0:1787781940.772525:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963006336 00000100:00100000:2.0:1787781940.772562:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787781940.772570:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963006336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781940.772650:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963006336:12345-0@lo:400:kworker.0 Request processed in 81us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.772658:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787781940.773394:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963006336:0@lo:400:kworker.0 00010000:00080000:3.0:1787781940.773415:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67d41680 x1874624963006848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781940.773425:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963006848:0@lo:400:kworker.0 00000001:00080000:0.0:1787781940.780419:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1787781941.259086:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781941.259116:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963007872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781941.259248:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781941.259390:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963007872 00000100:00100000:2.0:1787781941.259401:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963007872 00000100:00100000:2.0:1787781941.259468:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787781941.259480:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963007872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787781941.259520:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781941.259585:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963007872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.259593:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1787781941.259667:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d45e00 x1874624963007872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781941.259685:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963007872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781941.260004:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781941.260018:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963008000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781941.260058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781941.260177:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008000 00000100:00100000:1.0:1787781941.260183:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008000 00000100:00100000:1.0:1787781941.260226:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787781941.260245:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963008000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781941.260272:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781941.260318:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963008000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.260324:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1787781941.260392:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d4c0e8780 x1874624963008000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781941.260407:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963008000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781941.317884:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781941.648709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781941.648750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781941.648909:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993792 00000100:00100000:1.0:1787781941.648920:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993792 00000100:00100000:1.0:1787781941.648995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 369 00000100:00100000:1.0:1787781941.649005:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942993792:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781941.649075:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942993792:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.649082:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 369 00000100:00100000:0.0:1787781941.649832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781941.649865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781941.649894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781941.649914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781941.650103:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942993920 00000100:00100000:2.0:1787781941.650111:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942993920 00000100:00100000:2.0:1787781941.650162:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994432 00000100:00100000:2.0:1787781941.650165:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994432 00000100:00100000:2.0:1787781941.650178:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994304 00000100:00100000:2.0:1787781941.650180:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994304 00000100:00100000:2.0:1787781941.650192:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994048 00000100:00100000:2.0:1787781941.650194:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994048 00000100:00100000:2.0:1787781941.650219:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 238 00000100:00100000:2.0:1787781941.650227:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993920:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781941.650308:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942993920:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 81us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.650315:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 238 00000100:00100000:2.0:1787781941.650332:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 239 00000100:00100000:2.0:1787781941.650338:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942994432:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781941.650393:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942994432:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 54us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.650400:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 239 00000100:00100000:2.0:1787781941.650413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 240 00000100:00100000:2.0:1787781941.650419:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942994304:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781941.650441:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942994304:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 23us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.650448:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 240 00000100:00100000:2.0:1787781941.650459:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 241 00000100:00100000:2.0:1787781941.650465:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942994048:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781941.650486:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942994048:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.650491:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 241 00000100:00100000:1.0:1787781941.652855:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994176 00000100:00100000:1.0:1787781941.652868:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994176 00000100:00100000:1.0:1787781941.652954:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 112 00000100:00100000:1.0:1787781941.652964:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942994176:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781941.653033:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942994176:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 71us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.653040:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 112 00000100:00080000:0.0:1787781941.654037:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781941.654044:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781941.654047:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781941.767195:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963008128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781941.767278:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781941.770821:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008128 00000100:00100000:3.0:1787781941.770836:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008128 00000100:00100000:3.0:1787781941.770916:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787781941.770927:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963008128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781941.770960:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781941.771061:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963008128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (3782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781941.771068:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787781941.771191:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963008128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781941.771378:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963008256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781941.771427:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781941.771588:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008256 00000100:00100000:0.0:1787781941.771593:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008256 00000100:00100000:0.0:1787781941.771657:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787781941.771664:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963008256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781941.771677:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781941.771717:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963008256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781941.771737:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787781941.771763:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787781941.771768:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43e421c0, transno 4294967301 00000100:00100000:0.0:1787781941.771780:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963008256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781942.342757:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781943.366386:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781943.816307:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781943.816344:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963008384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787781943.816416:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781943.816668:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008384 00000100:00100000:0.0:1787781943.816677:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008384 00000100:00100000:0.0:1787781943.816728:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787781943.816737:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963008384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781943.816766:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781943.816813:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963008384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781943.816820:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787781943.816907:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963008384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787781944.391526:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781945.413836:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781945.861933:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963008768:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862001:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862054:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963009280:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862078:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862099:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963009792:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862147:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862172:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787781945.862188:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963008640:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862208:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862224:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963009152:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862242:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862260:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963009664:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.862276:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781945.862297:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009280 00000100:00100000:1.0:1787781945.862303:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009280 00000100:00100000:2.0:1787781945.863467:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008768 00000100:00100000:2.0:1787781945.863487:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008768 00000100:00100000:2.0:1787781945.863541:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781945.863551:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963008768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.863648:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963008768:12345-0@lo:400:kworker.0 Request processed in 99us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781945.863656:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781945.863686:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009792 00000100:00100000:2.0:1787781945.863690:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009792 00000100:00100000:1.0:1787781945.863953:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008640 00000100:00100000:1.0:1787781945.863957:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008640 00000100:00100000:1.0:1787781945.863972:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009152 00000100:00100000:1.0:1787781945.863975:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009152 00000100:00100000:1.0:1787781945.863988:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009664 00000100:00100000:1.0:1787781945.863991:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009664 00000100:00100000:1.0:1787781945.864007:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787781945.864074:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963008512:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864170:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963009024:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864204:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864224:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963009536:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864246:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864265:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ecbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963010048:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864284:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864304:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787781945.864311:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963008896:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864333:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864345:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963009408:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864383:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963009920:0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864402:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781945.864428:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008896 00000100:00100000:3.0:1787781945.864432:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008896 00000100:00100000:3.0:1787781945.864455:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787781945.864461:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963008640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864497:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963008640:12345-0@lo:400:kworker.0 Request processed in 35us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781945.864503:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787781945.864517:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787781945.864523:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963009152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864551:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963009152:12345-0@lo:400:kworker.0 Request processed in 28us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781945.864566:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787781945.864578:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787781945.864584:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963009664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864633:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963009664:12345-0@lo:400:kworker.0 Request processed in 49us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781945.864639:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787781945.864651:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787781945.864657:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963008896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.864688:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963008896:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781945.864693:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787781945.864767:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009024 00000100:00100000:3.0:1787781945.864771:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009024 00000100:00080000:0.0:1787781945.865059:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781945.865065:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781945.869847:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963009280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.869869:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787781945.869882:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781945.869994:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787781945.870003:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870094:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963009280:12345-0@lo:400:kworker.0 Request processed in 6079us (8013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870102:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787781945.870246:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009536 00000100:00100000:1.0:1787781945.870254:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009536 00000100:00100000:1.0:1787781945.870279:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010048 00000100:00100000:1.0:1787781945.870282:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010048 00000100:00100000:1.0:1787781945.870295:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009408 00000100:00100000:1.0:1787781945.870299:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009408 00000100:00100000:1.0:1787781945.870406:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963009920 00000100:00100000:1.0:1787781945.870411:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963009920 00000100:00100000:1.0:1787781945.870449:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781945.870455:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963009536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870496:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963009536:12345-0@lo:400:kworker.0 Request processed in 41us (6248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870502:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781945.870514:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787781945.870520:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963010048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870566:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963010048:12345-0@lo:400:kworker.0 Request processed in 46us (6281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870572:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787781945.870584:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787781945.870589:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963009408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870640:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963009408:12345-0@lo:400:kworker.0 Request processed in 51us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870646:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787781945.870656:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787781945.870662:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963009920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870687:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963009920:12345-0@lo:400:kworker.0 Request processed in 26us (6284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870693:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787781945.870748:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963008512 00000100:00100000:1.0:1787781945.870752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963008512 00000100:00100000:1.0:1787781945.870779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787781945.870785:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963008512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.870815:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963008512:12345-0@lo:400:kworker.0 Request processed in 30us (6679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.870829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:0.0:1787781945.870957:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781945.870961:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781945.871040:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963009792:12345-0@lo:400:kworker.0 Request processed in 1160us (8890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781945.871049:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787781945.871088:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963008640:0@lo:400:kworker.0 00000100:00100000:0.0:1787781945.871103:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963009152:0@lo:400:kworker.0 00000100:00100000:0.0:1787781945.871128:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963009664:0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.871140:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963008896:0@lo:400:kworker.0 00000100:00100000:0.0:1787781945.871147:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963008768:0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.871159:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963009408:0@lo:400:kworker.0 00010000:00080000:0.0:1787781945.871166:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ecb0c0 x1874624963009280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787781945.871187:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ec9e00 x1874624963009920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781945.871189:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963009280:0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.871201:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963009920:0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.871220:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963008512:0@lo:400:kworker.0 00010000:00080000:0.0:1787781945.871221:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ec8b40 x1874624963009792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781945.871235:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963009792:0@lo:400:kworker.0 00000100:00100000:2.0:1787781945.871238:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963009536:0@lo:400:kworker.0 00010000:00080000:2.0:1787781945.871256:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ecbc00 x1874624963010048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781945.871265:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ecbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963010048:0@lo:400:kworker.0 00000100:00100000:0.0:1787781945.871269:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781945.871281:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963010176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781945.871364:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963009024:12345-0@lo:400:kworker.0 Request processed in 1361us (7157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781945.871372:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787781945.871590:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781945.871714:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963009024:0@lo:400:kworker.0 00000100:00100000:1.0:1787781945.871736:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010176 00000100:00100000:1.0:1787781945.871742:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010176 00000100:00100000:1.0:1787781945.871829:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787781945.871838:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963010176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781945.871935:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787781945.871986:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963010176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.871992:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787781945.872048:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963010176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781946.373824:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781946.373846:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963010304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781946.373914:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781946.374185:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781946.374196:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963010432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781946.374227:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781946.374549:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010304 00000100:00100000:1.0:1787781946.374556:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010304 00000100:00100000:2.0:1787781946.374589:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010432 00000100:00100000:2.0:1787781946.374595:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010432 00000100:00100000:1.0:1787781946.374631:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787781946.374642:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963010304:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781946.374655:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787781946.374666:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963010432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781946.374671:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787781946.374679:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781946.374727:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963010304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781946.374736:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963010432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781946.374737:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787781946.374747:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1787781946.374792:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ecb480 x1874624963010432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781946.374810:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963010432:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787781946.374881:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c41d47840 x1874624963010304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781946.374894:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963010304:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781946.438333:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781946.760571:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760632:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760685:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760727:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760749:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781946.760775:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994944 00000100:00100000:3.0:1787781946.760785:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994944 00000100:00100000:3.0:1787781946.760841:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 117 00000100:00100000:3.0:1787781946.760851:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994944:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.760918:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994944:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.760925:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 117 00000100:00100000:3.0:1787781946.760948:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994688 00000100:00100000:3.0:1787781946.760951:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994688 00000100:00100000:3.0:1787781946.760973:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995200 00000100:00100000:3.0:1787781946.760975:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995200 00000100:00100000:3.0:1787781946.760987:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994816 00000100:00100000:3.0:1787781946.760989:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994816 00000100:00100000:3.0:1787781946.761001:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995072 00000100:00100000:3.0:1787781946.761003:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995072 00000100:00100000:3.0:1787781946.761016:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:3.0:1787781946.761023:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994688:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.761050:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994688:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.761057:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:3.0:1787781946.761068:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:3.0:1787781946.761073:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995200:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.761094:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995200:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.761100:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:3.0:1787781946.761119:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00100000:3.0:1787781946.761124:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994816:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.761146:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624942994816:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.761152:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00100000:3.0:1787781946.761163:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 251 00000100:00100000:3.0:1787781946.761181:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995072:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.761206:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995072:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 38us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.761212:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 251 00000100:00100000:3.0:1787781946.761231:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942994560 00000100:00100000:3.0:1787781946.761235:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942994560 00000100:00100000:3.0:1787781946.761257:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 371 00000100:00100000:3.0:1787781946.761264:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624942994560:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781946.761287:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624942994560:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.761294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 371 00000100:00080000:3.0:1787781946.761328:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781946.761332:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781946.761335:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781946.885840:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781946.885871:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963010560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781946.885936:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781946.886037:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010560 00000100:00100000:3.0:1787781946.886043:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010560 00000100:00100000:3.0:1787781946.886093:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787781946.886103:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963010560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781946.886130:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781946.886193:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963010560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.886200:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787781946.886283:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963010560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781946.889673:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781946.889697:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963010688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781946.889774:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781946.890140:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010688 00000100:00100000:2.0:1787781946.890150:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010688 00000100:00100000:2.0:1787781946.890219:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787781946.890229:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963010688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781946.890251:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781946.890300:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963010688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781946.890307:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787781946.890557:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963010688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781947.463275:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781948.486381:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781948.550332:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787781948.552551:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787781948.934962:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963010816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787781948.935072:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781948.935384:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010816 00000100:00100000:3.0:1787781948.935391:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010816 00000100:00100000:3.0:1787781948.935444:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781948.935453:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963010816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781948.935488:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781948.935546:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963010816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781948.935553:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787781948.935795:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963010816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787781949.509859:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781950.533939:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781950.983105:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963010944:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983197:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983263:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963011456:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983290:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983306:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963011968:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983330:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983348:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983370:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983394:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787781950.983399:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963011072:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983424:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983440:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963011584:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983460:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983474:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963012096:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983492:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.983521:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011968 00000100:00100000:2.0:1787781950.983527:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011968 00000100:00100000:2.0:1787781950.983574:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012480 00000100:00100000:2.0:1787781950.983577:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012480 00000100:00100000:2.0:1787781950.983594:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787781950.983602:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963011968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983679:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963011968:12345-0@lo:400:kworker.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781950.983698:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787781950.983714:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787781950.983720:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963012480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.983747:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963012480:12345-0@lo:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781950.983753:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787781950.983794:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963011968:0@lo:400:kworker.0 00010000:00080000:2.0:1787781950.983806:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4b43c0 x1874624963012480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781950.983817:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963012480:0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.984436:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963010944 00000100:00100000:3.0:1787781950.984443:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963010944 00000100:00100000:3.0:1787781950.984488:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787781950.984496:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963010944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.984563:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963010944:12345-0@lo:400:kworker.0 Request processed in 60us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.984570:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787781950.984602:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011072 00000100:00100000:3.0:1787781950.984637:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011072 00000100:00100000:3.0:1787781950.984665:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011584 00000100:00100000:3.0:1787781950.984668:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011584 00000100:00100000:3.0:1787781950.984681:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012096 00000100:00100000:3.0:1787781950.984683:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012096 00000100:00100000:3.0:1787781950.984696:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787781950.984702:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963011072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.984748:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963011072:12345-0@lo:400:kworker.0 Request processed in 46us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.984765:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787781950.984778:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787781950.984784:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963011584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.984820:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963011584:12345-0@lo:400:kworker.0 Request processed in 36us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.984825:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787781950.984846:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787781950.984853:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963012096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.984878:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963012096:12345-0@lo:400:kworker.0 Request processed in 27us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.984884:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1787781950.984908:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781950.985088:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781950.985091:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781950.985355:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011456 00000100:00100000:1.0:1787781950.985360:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011456 00000100:00100000:1.0:1787781950.985399:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787781950.985406:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963011456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.985455:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963011456:12345-0@lo:400:kworker.0 Request processed in 49us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781950.985462:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787781950.985573:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963011072:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.985587:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963011584:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.985597:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963012096:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.985630:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963010944:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.985642:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963011456:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986284:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963011200:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986335:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986371:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963011712:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986395:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986411:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963012224:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986431:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986448:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787781950.986455:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963011328:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986476:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986489:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963011840:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986511:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986529:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963012352:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986562:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781950.986594:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011840 00000100:00100000:1.0:1787781950.986598:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011840 00000100:00100000:1.0:1787781950.986651:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012352 00000100:00100000:1.0:1787781950.986654:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012352 00000100:00100000:1.0:1787781950.986673:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781950.986680:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963011840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.986723:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963011840:12345-0@lo:400:kworker.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781950.986729:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781950.987051:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787781950.987060:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963012352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.987092:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963012352:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781950.987098:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787781950.987122:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011200 00000100:00100000:1.0:1787781950.987125:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011200 00000100:00100000:1.0:1787781950.987331:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787781950.987340:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963011200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.987376:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963011200:12345-0@lo:400:kworker.0 Request processed in 38us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781950.987383:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787781950.987426:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963011840:0@lo:400:kworker.0 00010000:00080000:1.0:1787781950.987441:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4b6940 x1874624963012352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781950.987452:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963012352:0@lo:400:kworker.0 00000100:00100000:1.0:1787781950.987462:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963011200:0@lo:400:kworker.0 00000100:00100000:2.0:1787781950.987631:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781950.987642:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963012608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781950.987676:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781950.987703:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012608 00000100:00100000:2.0:1787781950.987707:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012608 00000100:00100000:2.0:1787781950.987732:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787781950.987737:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963012608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781950.987783:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781950.987841:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963012608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781950.987848:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787781950.987883:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963012608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781950.989947:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011712 00000100:00100000:3.0:1787781950.989958:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011712 00000100:00100000:3.0:1787781950.990162:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012224 00000100:00100000:3.0:1787781950.990167:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012224 00000100:00100000:3.0:1787781950.990189:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963011328 00000100:00100000:3.0:1787781950.990193:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963011328 00000100:00100000:3.0:1787781950.990209:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787781950.990217:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.990316:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963011712:12345-0@lo:400:kworker.0 Request processed in 99us (3919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.990323:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787781950.990351:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787781950.990357:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.990389:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963012224:12345-0@lo:400:kworker.0 Request processed in 33us (3957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.990395:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787781950.990405:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787781950.990411:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963011328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781950.990438:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963011328:12345-0@lo:400:kworker.0 Request processed in 28us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.990444:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1787781950.990471:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781950.990476:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781950.990479:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781950.991210:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963011328:0@lo:400:kworker.0 00010000:00080000:0.0:1787781950.991227:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43edda40 x1874624963011712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781950.991237:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963011712:0@lo:400:kworker.0 00010000:00080000:0.0:1787781950.991248:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43edf0c0 x1874624963012224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781950.991257:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963012224:0@lo:400:kworker.0 00000100:00100000:3.0:1787781951.493881:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781951.496235:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963012864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781951.496308:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781951.496391:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963012736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781951.496416:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.496522:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012864 00000100:00100000:0.0:1787781951.496531:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012864 00000100:00100000:0.0:1787781951.496578:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012736 00000100:00100000:0.0:1787781951.496581:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012736 00000100:00100000:0.0:1787781951.496597:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787781951.496620:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963012864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781951.496648:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781951.496694:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963012864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.496701:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787781951.496716:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781951.496723:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963012736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781951.496733:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781951.496756:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963012736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.496761:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1787781951.497110:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67d42940 x1874624963012864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781951.497129:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963012864:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787781951.497140:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67d430c0 x1874624963012736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781951.497163:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963012736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787781951.559662:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781951.880028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781951.880075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781951.880133:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781951.880178:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995584 00000100:00100000:3.0:1787781951.880187:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995584 00000100:00100000:3.0:1787781951.880242:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995456 00000100:00100000:3.0:1787781951.880245:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995456 00000100:00100000:0.0:1787781951.880514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995328 00000100:00100000:0.0:1787781951.880518:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995328 00000100:00100000:0.0:1787781951.880555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 373 00000100:00100000:0.0:1787781951.880565:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942995328:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781951.880683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624942995328:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 119us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.880690:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 373 00000100:00100000:0.0:1787781951.880877:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 258 00000100:00100000:0.0:1787781951.880886:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942995584:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781951.880941:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942995584:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 56us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.880948:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 258 00000100:00100000:0.0:1787781951.880966:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 259 00000100:00100000:0.0:1787781951.880972:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942995456:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781951.880998:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624942995456:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.881005:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 259 00000100:00080000:0.0:1787781951.881023:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781951.881028:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781951.897228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781951.897437:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995712 00000100:00100000:1.0:1787781951.897447:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995712 00000100:00100000:1.0:1787781951.897526:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:1.0:1787781951.897538:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624942995712:12345-192.168.206.16@tcp:9:kworker.0 00000020:00000080:1.0:1787781951.897567:0:8638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063541 00000100:00080000:1.0:1787781951.897576:0:8638:0:(import.c:65:import_set_state_nolock()) ffff993d67f87000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781951.897648:0:8638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787781951.897861:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787781951.897883:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781951.898071:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+2:2405:x1874624942995712:12345-192.168.206.16@tcp:9:kworker.0 Request processed in 535us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781951.898096:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:3.0:1787781951.898189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781951.898460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781951.898657:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995840 00000100:00100000:2.0:1787781951.898663:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995840 00000100:00100000:2.0:1787781951.898714:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942995968 00000100:00100000:2.0:1787781951.898718:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942995968 00000100:00100000:2.0:1787781951.898742:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 260 00000100:00100000:2.0:1787781951.898749:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995840:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781951.898791:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995840:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 42us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781951.898798:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 260 00000100:00100000:2.0:1787781951.898812:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 261 00000100:00100000:2.0:1787781951.898818:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995968:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781951.898851:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624942995968:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781951.898858:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 261 00000100:00080000:3.0:1787781951.899064:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781951.899069:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781952.006190:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963012992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781952.006257:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781952.006344:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781952.006350:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963013120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781952.006372:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781952.006440:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963012992 00000100:00100000:3.0:1787781952.006447:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963012992 00000100:00100000:3.0:1787781952.006495:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013120 00000100:00100000:3.0:1787781952.006498:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013120 00000100:00100000:3.0:1787781952.006513:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787781952.006521:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963012992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781952.006545:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781952.006585:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963012992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781952.006591:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787781952.006630:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787781952.006638:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963013120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781952.006646:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781952.006670:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963013120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781952.006675:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1787781952.007000:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781952.007040:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963013120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781952.007055:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963012992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781952.582177:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781953.608098:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781954.053943:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781954.053977:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ec92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963013248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781954.054045:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781954.054441:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013248 00000100:00100000:2.0:1787781954.054448:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013248 00000100:00100000:2.0:1787781954.054494:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787781954.054502:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963013248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781954.054532:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781954.054603:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963013248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781954.054634:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781954.055224:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ec92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963013248:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781954.630865:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781955.655198:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781956.101980:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963013376:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.102084:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781956.102167:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963013888:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.102219:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781956.102254:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963014400:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.102280:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.102325:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963013760:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.102397:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.102430:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963014272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.102456:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.102473:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41325a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963014784:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.102488:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41324780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963014912:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.102502:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781956.102534:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.102557:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963013632:0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.102650:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013376 00000100:00100000:3.0:1787781956.102659:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013376 00000100:00100000:3.0:1787781956.102707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787781956.102715:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963013376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.102839:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963013504:0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.110245:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963013376:12345-0@lo:400:kworker.0 Request processed in 7518us (8148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781956.110264:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787781956.110367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781956.110416:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963014016:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.110457:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781956.110505:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963013376:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.110562:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013888 00000100:00100000:0.0:1787781956.110568:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013888 00000100:00100000:0.0:1787781956.110626:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787781956.110636:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.110676:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014400 00000100:00100000:3.0:1787781956.110682:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014400 00000100:00100000:0.0:1787781956.110715:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963013888:12345-0@lo:400:kworker.0 Request processed in 78us (8492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781956.110722:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014272 00000100:00100000:0.0:1787781956.110727:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787781956.110728:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014272 00000100:00100000:3.0:1787781956.110750:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014784 00000100:00100000:3.0:1787781956.110754:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014784 00000100:00100000:3.0:1787781956.110773:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014912 00000100:00100000:3.0:1787781956.110776:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014912 00000100:00100000:0.0:1787781956.110791:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963013888:0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.110795:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787781956.110805:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963014400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.110854:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963014400:12345-0@lo:400:kworker.0 Request processed in 51us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781956.110865:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787781956.110877:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963014272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.110925:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963014272:12345-0@lo:400:kworker.0 Request processed in 52us (8468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.111334:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.111402:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963014144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.111460:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.111481:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963014656:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.111529:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.111770:0:8638:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787781956.111780:0:8638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787781956.111807:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013760 00000100:00100000:1.0:1787781956.111815:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013760 00000100:00100000:1.0:1787781956.111855:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013504 00000100:00100000:1.0:1787781956.111858:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013504 00000100:00100000:1.0:1787781956.111869:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014016 00000100:00100000:1.0:1787781956.111871:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014016 00000100:00100000:1.0:1787781956.111885:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014144 00000100:00100000:1.0:1787781956.111887:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014144 00000100:00100000:1.0:1787781956.111898:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014656 00000100:00100000:1.0:1787781956.111900:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014656 00000100:00100000:1.0:1787781956.111917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787781956.111936:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963013760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.111990:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963013760:12345-0@lo:400:kworker.0 Request processed in 55us (9593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.111997:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787781956.112015:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787781956.112021:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112050:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963013504:12345-0@lo:400:kworker.0 Request processed in 30us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.112056:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787781956.112067:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787781956.112073:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963014016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112099:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963014016:12345-0@lo:400:kworker.0 Request processed in 27us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.112105:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787781956.112116:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787781956.112132:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963014144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112165:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963014144:12345-0@lo:400:kworker.0 Request processed in 34us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.112171:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787781956.112184:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787781956.112191:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963014656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112217:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963014656:12345-0@lo:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.112223:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787781956.112243:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963013632 00000100:00100000:1.0:1787781956.112253:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963013632 00000100:00100000:1.0:1787781956.112282:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781956.112288:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963013632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112318:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963013632:12345-0@lo:400:kworker.0 Request processed in 31us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.112324:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781956.112365:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963013760:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112379:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963014272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112412:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963013632:0@lo:400:kworker.0 00010000:00080000:1.0:1787781956.112426:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7c4b4f00 x1874624963014144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781956.112437:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963014144:0@lo:400:kworker.0 00010000:00080000:1.0:1787781956.112447:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d413252c0 x1874624963014656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781956.112457:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963014656:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.112499:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787781956.115106:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787781956.115516:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963014016:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.115529:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.115586:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781956.115668:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963013504:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.115699:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963014528 00000100:00100000:2.0:1787781956.115705:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963014528 00000100:00100000:2.0:1787781956.115746:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787781956.115754:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963014528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.115806:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963014528:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781956.115812:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787781956.115882:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963015040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781956.115909:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781956.115934:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.115954:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015040 00000100:00100000:2.0:1787781956.115958:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015040 00000100:00100000:2.0:1787781956.115981:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787781956.115987:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963015040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781956.116027:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787781956.116234:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787781956.116259:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787781956.116267:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963014784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.116313:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963014784:12345-0@lo:400:kworker.0 Request processed in 48us (13813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781956.116320:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787781956.116340:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787781956.116347:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963014912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.116381:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963014912:12345-0@lo:400:kworker.0 Request processed in 33us (13846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781956.116387:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787781956.116417:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963014400:0@lo:400:kworker.0 00010000:00080000:0.0:1787781956.116430:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d41324780 x1874624963014912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781956.116441:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41324780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963014912:0@lo:400:kworker.0 00010000:00080000:0.0:1787781956.116483:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d41325a40 x1874624963014784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781956.116492:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41325a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963014784:0@lo:400:kworker.0 00000100:00080000:0.0:1787781956.116590:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781956.116595:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781956.116597:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781956.116599:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781956.117336:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963015040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1346us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781956.117344:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787781956.117772:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963015040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781956.613871:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781956.613899:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963015168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781956.613971:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781956.614038:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015168 00000100:00100000:3.0:1787781956.614051:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015168 00000100:00100000:3.0:1787781956.614136:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787781956.614149:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963015168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781956.614201:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781956.614565:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963015168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 418us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781956.614573:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787781956.615360:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781956.615376:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50322d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963015296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781956.615424:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.615473:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015296 00000100:00100000:1.0:1787781956.615480:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015296 00000100:00100000:1.0:1787781956.615522:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787781956.615531:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963015296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781956.615552:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781956.615625:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963015296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.615632:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1787781956.615667:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d50322d00 x1874624963015296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781956.615684:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50322d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963015296:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787781956.615816:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d413270c0 x1874624963015168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781956.615845:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963015168:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781956.678787:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781957.002344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781957.002379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781957.002399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781957.002416:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781957.002439:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781957.002467:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996096 00000100:00100000:1.0:1787781957.002477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996096 00000100:00100000:1.0:1787781957.002523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 375 00000100:00100000:1.0:1787781957.002532:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942996096:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781957.002594:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2409:x1874624942996096:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.002602:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 375 00000100:00100000:1.0:1787781957.002647:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996352 00000100:00100000:1.0:1787781957.002651:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996352 00000100:00100000:1.0:1787781957.002947:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996608 00000100:00100000:1.0:1787781957.002951:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996608 00000100:00100000:1.0:1787781957.002966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996224 00000100:00100000:1.0:1787781957.002969:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996224 00000100:00100000:1.0:1787781957.002980:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996480 00000100:00100000:1.0:1787781957.002982:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996480 00000100:00100000:1.0:1787781957.002995:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 268 00000100:00100000:1.0:1787781957.003008:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942996352:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781957.003043:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942996352:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.003050:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 268 00000100:00100000:1.0:1787781957.003062:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 269 00000100:00100000:1.0:1787781957.003069:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50322940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942996608:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781957.003093:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50322940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942996608:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.003100:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 269 00000100:00100000:1.0:1787781957.003112:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 270 00000100:00100000:1.0:1787781957.003129:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942996224:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781957.003769:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2409:x1874624942996224:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.003780:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 270 00000100:00100000:1.0:1787781957.003798:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 271 00000100:00100000:1.0:1787781957.003808:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942996480:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781957.003842:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624942996480:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 38us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.003934:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 271 00000100:00080000:0.0:1787781957.004693:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781957.004700:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781957.127767:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781957.127789:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963015424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781957.127867:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781957.127948:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015424 00000100:00100000:3.0:1787781957.127961:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015424 00000100:00100000:3.0:1787781957.128011:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787781957.128022:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963015424:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781957.128022:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781957.128038:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963015552:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781957.128053:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781957.128075:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781957.132280:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015552 00000100:00100000:1.0:1787781957.132298:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015552 00000100:00100000:1.0:1787781957.132477:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787781957.132488:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963015552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781957.132513:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781957.132578:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963015552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (4503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781957.132585:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787781957.135005:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963015424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6979us (7132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781957.135030:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787781957.135225:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963015424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781957.135237:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963015552:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787781957.657217:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:2.0:1787781957.657227:0:8439:0:(genops.c:885:class_export_put()) final put ffff993d67f83000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:3.0:1787781957.657408:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67f83000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-OST0000 00000020:00000080:3.0:1787781957.657467:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d67f87000 for lustre-OST0000 00010000:00010000:1.0:1787781957.703890:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781958.727597:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781958.792296:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787781958.794311:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787781959.174442:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50321a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963015680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781959.174522:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781959.174640:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015680 00000100:00100000:1.0:1787781959.174651:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015680 00000100:00100000:0.0:1787781959.175099:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781959.176005:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963015680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781959.176061:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781959.176144:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963015680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781959.176815:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50321a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963015680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781959.176895:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00010000:0.0:1787781959.749749:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781960.773861:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781961.222083:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781961.222126:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963015808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781961.222223:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781961.222404:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015808 00000100:00100000:2.0:1787781961.222414:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015808 00000100:00100000:2.0:1787781961.222521:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787781961.222532:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963015808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787781961.222565:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787781961.222693:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963015808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781961.222701:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787781961.222804:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963015808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781961.222846:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41327c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963015936:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.222899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.222954:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963016448:0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.222963:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963016320:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.222995:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781961.223023:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223036:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41325680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963016960:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223076:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223132:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41326d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963016064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223158:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223195:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963016576:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223217:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223233:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41327840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963017088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223268:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223282:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787781961.223288:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963016192:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223309:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223336:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963016704:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223362:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223380:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963017216:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223401:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.223431:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963015936 00000100:00100000:0.0:1787781961.223436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963015936 00000100:00100000:0.0:1787781961.223468:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787781961.223475:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963015936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223512:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963015936:12345-0@lo:400:kworker.0 Request processed in 38us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787781961.223548:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016448 00000100:00100000:0.0:1787781961.223552:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016448 00000100:00100000:0.0:1787781961.223580:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016960 00000100:00100000:0.0:1787781961.223583:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016960 00000100:00100000:0.0:1787781961.223598:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016064 00000100:00100000:0.0:1787781961.223600:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016064 00000100:00100000:0.0:1787781961.223634:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016576 00000100:00100000:0.0:1787781961.223637:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016576 00000100:00100000:0.0:1787781961.223649:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017088 00000100:00100000:0.0:1787781961.223651:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017088 00000100:00100000:0.0:1787781961.223664:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016192 00000100:00100000:0.0:1787781961.223666:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016192 00000100:00100000:0.0:1787781961.223680:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787781961.223686:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223719:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963016448:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223726:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787781961.223738:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787781961.223750:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223780:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963016960:12345-0@lo:400:kworker.0 Request processed in 30us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223786:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787781961.223800:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787781961.223806:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963016064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223839:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963016064:12345-0@lo:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223845:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787781961.223857:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787781961.223863:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223890:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963016576:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223895:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787781961.223906:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787781961.223911:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963017088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223936:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963017088:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223943:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787781961.223954:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787781961.223960:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.223986:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963016192:12345-0@lo:400:kworker.0 Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.223991:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787781961.224014:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016704 00000100:00100000:0.0:1787781961.224024:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016704 00000100:00100000:0.0:1787781961.224053:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017216 00000100:00100000:0.0:1787781961.224057:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017216 00000100:00100000:0.0:1787781961.224077:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787781961.224083:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224129:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963016704:12345-0@lo:400:kworker.0 Request processed in 46us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.224135:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787781961.224145:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787781961.224151:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963017216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224178:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963017216:12345-0@lo:400:kworker.0 Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.224183:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1787781961.224204:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781961.224207:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781961.224210:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781961.224212:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781961.224237:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963016192:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224248:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963016704:0@lo:400:kworker.0 00010000:00080000:0.0:1787781961.224259:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d413270c0 x1874624963017216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781961.224268:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963017216:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224280:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41326d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963016064:0@lo:400:kworker.0 00010000:00080000:0.0:1787781961.224289:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d41324000 x1874624963016576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781961.224310:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963016576:0@lo:400:kworker.0 00010000:00080000:0.0:1787781961.224322:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d41327840 x1874624963017088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781961.224330:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41327840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963017088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224375:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d413243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963016448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224384:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41325680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963016960:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.224391:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41327c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963015936:0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.226699:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963016832:0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.226779:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781961.226808:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41325a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963017344:0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.226829:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781961.226898:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016832 00000100:00100000:3.0:1787781961.227035:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016832 00000100:00100000:3.0:1787781961.227114:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017344 00000100:00100000:3.0:1787781961.227118:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017344 00000100:00100000:3.0:1787781961.227146:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781961.227155:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963016832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.227217:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963016832:12345-0@lo:400:kworker.0 Request processed in 63us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781961.227225:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781961.227242:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787781961.227248:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963017344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781961.227274:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963017344:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781961.227280:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1787781961.227319:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781961.227324:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781961.227370:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963016832:0@lo:400:kworker.0 00010000:00080000:3.0:1787781961.227386:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d41325a40 x1874624963017344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781961.227421:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41325a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963017344:0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.228548:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963016320 00000100:00100000:1.0:1787781961.228562:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963016320 00000100:00100000:1.0:1787781961.228663:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787781961.228672:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.228778:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963016320:12345-0@lo:400:kworker.0 Request processed in 107us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781961.228785:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787781961.229810:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963016320:0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.742195:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963017472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781961.742281:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.742324:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017472 00000100:00100000:0.0:1787781961.742333:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017472 00000100:00100000:0.0:1787781961.742452:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787781961.742464:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963017472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781961.742498:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781961.742551:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963017472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781961.742559:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1787781961.742634:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d50320780 x1874624963017472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781961.743267:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781961.743283:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963017600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781961.743324:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781961.744601:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017600 00000100:00100000:2.0:1787781961.744661:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017600 00000100:00100000:0.0:1787781961.745438:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963017472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781961.746142:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787781961.746154:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963017600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787781961.746183:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781961.746285:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963017600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781961.746315:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1787781961.748099:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43edf480 x1874624963017600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781961.748134:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963017600:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787781961.798021:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781962.030476:0:14073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:06:00 (1787781960) 00000100:00100000:0.0:1787781962.124941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781962.124977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781962.125108:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996736 00000100:00100000:1.0:1787781962.125120:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996736 00000100:00100000:1.0:1787781962.125178:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 377 00000100:00100000:1.0:1787781962.125188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624942996736:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781962.125277:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624942996736:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781962.125296:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 377 00000100:00100000:0.0:1787781962.125924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781962.134490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781962.137898:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996992 00000100:00100000:2.0:1787781962.137913:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996992 00000100:00080000:2.0:1787781962.137956:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781962.139152:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997248 00000100:00100000:2.0:1787781962.139168:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997248 00000100:00080000:2.0:1787781962.139207:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781962.139257:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 278 00000100:00100000:2.0:1787781962.139269:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942996992:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781962.139383:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942996992:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 116us (14403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781962.139392:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 278 00000100:00100000:2.0:1787781962.139418:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 279 00000100:00100000:2.0:1787781962.139425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942997248:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781962.139451:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942997248:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (13530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781962.139457:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 279 00000100:00100000:0.0:1787781962.139774:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942996864 00000100:00100000:0.0:1787781962.139780:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942996864 00000100:00100000:0.0:1787781962.139812:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 280 00000100:00100000:0.0:1787781962.139820:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942996864:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781962.139849:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624942996864:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 32us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781962.139856:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 280 00000100:00100000:0.0:1787781962.139976:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781962.139991:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997120 00000100:00100000:0.0:1787781962.140005:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997120 00000100:00100000:0.0:1787781962.140025:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 281 00000100:00100000:0.0:1787781962.140031:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942997120:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781962.140056:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624942997120:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781962.140062:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 281 00000100:00080000:2.0:1787781962.141113:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781962.253869:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781962.253906:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963017728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781962.254007:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781962.254107:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017728 00000100:00100000:3.0:1787781962.254115:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017728 00000100:00100000:3.0:1787781962.254174:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787781962.254183:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41325a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963017728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781962.254217:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781962.254264:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41325a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963017728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781962.254272:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787781962.254412:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963017728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781962.259941:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781962.259971:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963017856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781962.260070:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781962.260154:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017856 00000100:00100000:1.0:1787781962.260163:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017856 00000100:00100000:1.0:1787781962.260220:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787781962.260230:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963017856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781962.260259:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781962.260306:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963017856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781962.260314:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787781962.260364:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963017856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781962.821844:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781963.845724:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781963.899444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781963.899598:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997376 00000100:00100000:0.0:1787781963.899631:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997376 00000100:00100000:0.0:1787781963.899693:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:0.0:1787781963.899702:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:11117:x1874624942997376:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781963.899724:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781963.899751:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8398c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899813:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899844:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899857:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781963.899902:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787781963.899905:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781963.899943:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899966:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8398c expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899986:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8398c expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.899994:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:0.0:1787781963.899997:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781963.900000:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9400, rc 0) 00000100:00100000:0.0:1787781963.900056:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:11117:x1874624942997376:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 355us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781963.900063:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:0.0:1787781963.905038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781963.905585:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997504 00000100:00100000:2.0:1787781963.905596:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997504 00000100:00100000:2.0:1787781963.905683:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:2.0:1787781963.905692:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:11118:x1874624942997504:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781963.905720:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781963.905740:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506362f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83993 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905804:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905819:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905831:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905846:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905853:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905861:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905922:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905929:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.905936:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781963.905972:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787781963.905982:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781963.906006:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906016:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906022:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906028:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906034:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781963.906037:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906044:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906055:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:2.0:1787781963.906058:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781963.906062:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906068:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906094:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906100:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906115:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906120:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781963.906123:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906130:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906138:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff993c436a4200) 00010000:00010000:2.0:1787781963.906140:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781963.906143:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906148:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506363d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906180:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506362f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83993 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906193:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83993 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781963.906199:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:2.0:1787781963.906201:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781963.906204:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4600, rc 0) 00000100:00100000:2.0:1787781963.909319:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11118:x1874624942997504:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 3615us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781963.909356:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:2.0:1787781963.920132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781963.920202:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997632 00000100:00100000:1.0:1787781963.920214:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997632 00000100:00100000:1.0:1787781963.920283:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:1.0:1787781963.920294:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11118:x1874624942997632:12345-192.168.206.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787781963.920384:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11118:x1874624942997632:12345-192.168.206.16@tcp:900:lhsmtool_posix.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781963.920392:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:3.0:1787781963.926136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781963.926245:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942997888 00000100:00100000:0.0:1787781963.926254:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942997888 00000100:00100000:0.0:1787781963.926310:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:0.0:1787781963.926320:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11118:x1874624942997888:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781963.926357:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781963.926379:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506364b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb8399a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926450:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926465:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926478:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926492:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926499:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926506:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926657:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15063660 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926666:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15063660 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926673:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15063660 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781963.926683:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787781963.926782:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926789:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926795:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926801:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781963.926805:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926813:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926824:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:0.0:1787781963.926828:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781963.926832:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926838:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063652 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926850:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926856:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926862:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926878:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781963.926881:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926887:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926896:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff993d679e3800) 00010000:00010000:0.0:1787781963.926899:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781963.926902:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.926908:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063659 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.927246:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c1506364b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8399a expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.927262:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15063660 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8399a expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781963.927269:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:0.0:1787781963.927272:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781963.927274:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8a00, rc 0) 00000100:00100000:0.0:1787781963.927327:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11118:x1874624942997888:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 1009us (1198us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787781963.927335:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:0.0:1787781963.947455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781963.947567:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998016 00000100:00100000:1.0:1787781963.947576:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998016 00000100:00100000:1.0:1787781963.947678:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:1.0:1787781963.947689:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11118:x1874624942998016:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787781963.947798:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11118:x1874624942998016:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 110us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781963.947806:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:2.0:1787781963.951155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781963.951263:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998144 00000100:00100000:0.0:1787781963.951273:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998144 00000100:00100000:0.0:1787781963.951332:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:0.0:1787781963.951342:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:11118:x1874624942998144:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787781963.954833:0:6533:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3450us 00000100:00100000:2.0:1787781964.002737:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:11118:x1874624942998144:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 51374us (51567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781964.002753:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:3.0:1787781964.293861:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781964.293885:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963017984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781964.293954:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781964.294070:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963017984 00000100:00100000:1.0:1787781964.294090:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963017984 00000100:00100000:1.0:1787781964.294146:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787781964.294155:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963017984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781964.294188:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781964.294241:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963017984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781964.294249:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787781964.294292:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963017984:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787781964.874675:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781964.934583:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787781964.939306:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787781965.896998:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781965.963204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781965.963336:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998272 00000100:00100000:3.0:1787781965.963346:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998272 00000100:00080000:2.0:1787781965.963408:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781965.963423:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:3.0:1787781965.963438:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11161:x1874624942998272:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781965.963470:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781965.963490:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506366e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839a1 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963552:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963565:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963579:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963592:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963598:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963604:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963693:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963700:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963706:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963712:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781965.963722:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963730:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963741:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:3.0:1787781965.963744:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781965.963749:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963755:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963765:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963771:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963777:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963781:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781965.963784:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963789:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963796:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff993d6d094900) 00010000:00010000:3.0:1787781965.963798:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781965.963808:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963814:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506367c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963845:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506366e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839a1 expref: 10 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963855:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:3.0:1787781965.963857:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781965.963860:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506366e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839a1 expref: 10 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781965.963869:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704e00, rc 0) 00000100:00100000:3.0:1787781965.963919:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11161:x1874624942998272:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 488us (725us total) trans 0 rc 301/301 00000100:00100000:3.0:1787781965.972284:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:0.0:1787781965.974154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781965.974645:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998528 00000100:00100000:2.0:1787781965.974655:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998528 00000100:00100000:2.0:1787781965.974716:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:2.0:1787781965.974727:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:11161:x1874624942998528:12345-192.168.206.16@tcp:36:lfs.0 00010000:00010000:2.0:1787781965.974779:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781965.974806:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8398c expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974825:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e3300) 00010000:00010000:2.0:1787781965.974837:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781965.974899:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974911:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974921:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974946:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974954:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.974961:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975445:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975457:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975465:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781965.975480:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089f50699 reply state 000000008914bf0f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975490:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975497:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781965.975500:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781965.975504:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787781965.975510:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787781965.975518:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975524:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975537:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975544:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781965.975548:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975555:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975564:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993c436a7000) 00010000:00010000:2.0:1787781965.975567:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781965.975570:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975576:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063683 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781965.975595:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089f50699 reply state 000000008914bf0f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975602:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781965.975640:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff993c436a7a00) 00010000:00010000:2.0:1787781965.975642:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781965.975644:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787781965.975796:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:11161:x1874624942998528:12345-192.168.206.16@tcp:36:lfs.0 Request processed in 1069us (1646us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787781965.975805:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:2.0:1787781966.089563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.090395:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998656 00000100:00100000:0.0:1787781966.090415:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998656 00000100:00100000:0.0:1787781966.090485:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787781966.090496:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:11169:x1874624942998656:12345-192.168.206.16@tcp:101:lctl.0 00010000:00010000:0.0:1787781966.090530:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781966.090554:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839a8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.090649:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.090662:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.090673:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781966.090717:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787781966.090720:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781966.090769:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.090991:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839a8 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.091015:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839a8 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.091024:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781966.091027:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781966.091030:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9800, rc 0) 00000100:00100000:0.0:1787781966.091301:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:11169:x1874624942998656:12345-192.168.206.16@tcp:101:lctl.0 Request processed in 806us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.091309:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:2.0:1787781966.184224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.184986:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942998784 00000100:00100000:0.0:1787781966.184996:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942998784 00000100:00100000:0.0:1787781966.185137:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:0.0:1787781966.185149:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:11175:x1874624942998784:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781966.187149:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781966.187321:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150636a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839af expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187397:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187411:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187422:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187450:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187458:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187465:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187746:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187755:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187762:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781966.187796:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787781966.187800:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781966.187838:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187850:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187855:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187862:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187877:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781966.187881:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187889:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187901:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781966.187904:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781966.187908:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187914:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150636ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187928:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187934:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187940:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187945:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781966.187948:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187954:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187972:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff993c436a7a00) 00010000:00010000:0.0:1787781966.187975:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781966.187979:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.187985:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c150636b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.188012:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150636a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839af expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.189160:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839af expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.189460:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781966.189463:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787781966.189466:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8600, rc 0) 00000100:00100000:0.0:1787781966.189628:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11175:x1874624942998784:12345-192.168.206.16@tcp:101:bash.0 Request processed in 4479us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.189637:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:2.0:1787781966.193867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781966.194147:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999040 00000100:00100000:1.0:1787781966.194158:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999040 00000100:00100000:1.0:1787781966.196914:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:1.0:1787781966.196928:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11175:x1874624942999040:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781966.196948:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781966.196969:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150636c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839b6 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197102:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197117:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197149:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197224:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197240:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197248:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781966.197570:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787781966.197738:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197747:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197754:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197786:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197793:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197800:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197806:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781966.197816:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197825:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197837:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787781966.197840:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781966.197845:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197852:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150636c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781966.197865:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d397575 reply state 000000002bf8ad90 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197875:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197880:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:1.0:1787781966.197882:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787781966.197885:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787781966.197914:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150636c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197928:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.197935:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:1.0:1787781966.197938:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781966.197946:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa400, rc 0) 00000100:00100000:1.0:1787781966.198025:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:11175:x1874624942999040:12345-192.168.206.16@tcp:101:bash.0 Request processed in 1099us (4165us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787781966.198034:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:2.0:1787781966.205707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.205992:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999168 00000100:00100000:0.0:1787781966.206002:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999168 00000100:00100000:0.0:1787781966.206053:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:0.0:1787781966.206071:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1874624942999168:12345-192.168.206.16@tcp:8:bash.0 00010000:00080000:0.0:1787781966.206105:0:8445:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:0.0:1787781966.206151:0:8445:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c150636e5 00002000:00100000:0.0:1787781966.206163:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd0eda9e-1cb2-4b8a-8952-0f785606e4c5/ffff993c43e99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781966.206192:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781966.206268:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787781966.206318:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993d7c4a8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781966.206391:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624942999168:12345-192.168.206.16@tcp:8:bash.0 Request processed in 328us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.206399:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:2.0:1787781966.233597:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.233774:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999296 00000100:00100000:3.0:1787781966.233784:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999296 00000100:00100000:3.0:1787781966.233850:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:3.0:1787781966.233860:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624942999296:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781966.233877:0:13830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781966.233909:0:13830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839bd expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781966.233934:0:13830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787781966.233951:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1787781966.233982:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781966.233992:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 7 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.234015:0:13830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 7 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.234028:0:13830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704e00, rc 0) 00000100:00100000:3.0:1787781966.234098:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:0:x1874624942999296:12345-192.168.206.16@tcp:101:bash.0 Request processed in 239us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.234105:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00080000:2.0:1787781966.234410:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781966.237980:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.238091:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999424 00000100:00100000:3.0:1787781966.238153:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999424 00000100:00100000:3.0:1787781966.238260:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:3.0:1787781966.238271:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11175:x1874624942999424:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781966.238290:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781966.238318:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839c4 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.238354:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.238365:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781966.238370:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781966.238383:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.238432:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.238444:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781966.238457:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41327c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1874624963018112:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781966.238548:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781966.242880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.242913:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41327c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1874624963018112:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781966.242945:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.242964:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704800, rc 0) 00000100:00100000:3.0:1787781966.243037:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:11175:x1874624942999424:12345-192.168.206.16@tcp:101:bash.0 Request processed in 4768us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.243046:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:2.0:1787781966.243076:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999552 00000100:00100000:2.0:1787781966.243082:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999552 00010000:00010000:2.0:1787781966.243172:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781966.243214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:2.0:1787781966.243223:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624942999552:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781966.243508:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781966.243540:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.243554:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.243579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5ea3eb/0xc6d6745c150636ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839bd expref: 8 pid: 13830 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.243594:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781966.243598:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781966.243916:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.243928:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.243977:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781966.243996:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6518:1874624963018240:192.168.206.16@tcp:105: 00000100:00100000:2.0:1787781966.244077:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781966.247477:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6518:1874624963018240:192.168.206.16@tcp:105: 00010000:00010000:2.0:1787781966.247503:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781966.247562:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624942999552:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 4339us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781966.247573:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:0.0:1787781966.248596:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.248725:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624942999808 00000100:00100000:2.0:1787781966.248732:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624942999808 00000100:00100000:2.0:1787781966.248787:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:2.0:1787781966.248795:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:11175:x1874624942999808:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:2.0:1787781966.249328:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11175:x1874624942999808:12345-192.168.206.16@tcp:35:bash.0 Request processed in 532us (733us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787781966.249337:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:0.0:1787781966.341915:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781966.341937:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963018368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781966.342004:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781966.342117:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963018368 00000100:00100000:1.0:1787781966.342125:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963018368 00000100:00100000:1.0:1787781966.342181:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787781966.342190:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963018368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781966.342225:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787781966.342281:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963018368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781966.342289:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787781966.342314:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963018368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781966.342546:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963018752:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342599:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342658:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963019264:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342686:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342711:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963019776:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342729:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342747:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787781966.342752:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963018624:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342769:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342784:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963019136:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342800:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342813:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963019648:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342831:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.342854:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019264 00000100:00100000:0.0:1787781966.342858:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019264 00000100:00100000:0.0:1787781966.342904:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019776 00000100:00100000:0.0:1787781966.342908:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019776 00000100:00100000:0.0:1787781966.342933:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787781966.342941:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963019264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.342982:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963019264:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.342988:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787781966.343003:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787781966.343008:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963019776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343034:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963019776:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.343039:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787781966.343060:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781966.343077:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781966.343097:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963019264:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343107:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963019776:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343134:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963018752 00000100:00100000:0.0:1787781966.343137:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963018752 00000100:00100000:0.0:1787781966.343156:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963018624 00000100:00100000:0.0:1787781966.343158:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963018624 00000100:00100000:0.0:1787781966.343169:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019136 00000100:00100000:0.0:1787781966.343171:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019136 00000100:00100000:0.0:1787781966.343189:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019648 00000100:00100000:0.0:1787781966.343191:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019648 00000100:00100000:0.0:1787781966.343204:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787781966.343552:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963018496:0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343590:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781966.343650:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963019008:0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343675:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781966.343687:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963019520:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343694:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963018752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343716:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781966.343729:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787781966.343736:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963018880:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343740:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963018752:12345-0@lo:400:kworker.0 Request processed in 51us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.343755:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787781966.343756:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.343768:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019008 00000100:00100000:0.0:1787781966.343771:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019008 00000100:00100000:3.0:1787781966.343772:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963019392:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343785:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019520 00000100:00100000:0.0:1787781966.343788:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019520 00000100:00100000:3.0:1787781966.343791:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.343801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787781966.343806:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963018624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343807:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963019904:0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343827:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781966.343832:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963018624:12345-0@lo:400:kworker.0 Request processed in 26us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.343838:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787781966.343849:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787781966.343852:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963018880 00000100:00100000:3.0:1787781966.343855:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963018880 00000100:00100000:0.0:1787781966.343855:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963019136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.343879:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787781966.343885:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963018880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343886:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963019136:12345-0@lo:400:kworker.0 Request processed in 26us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.343891:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787781966.343903:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787781966.343909:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963019648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343938:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963019648:12345-0@lo:400:kworker.0 Request processed in 29us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781966.343944:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019392 00000100:00100000:0.0:1787781966.343945:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787781966.343951:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019392 00000100:00100000:0.0:1787781966.343960:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787781966.343967:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963019008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.343997:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963019008:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.344002:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787781966.344020:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787781966.344026:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963019520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.344054:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963019520:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.344059:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787781966.344091:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963018496 00000100:00100000:0.0:1787781966.344095:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963018496 00000100:00100000:3.0:1787781966.344100:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963018880:12345-0@lo:400:kworker.0 Request processed in 215us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.344106:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787781966.344123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787781966.344131:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963019904 00000100:00100000:0.0:1787781966.344131:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963018496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.344134:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963019904 00000100:00080000:1.0:1787781966.344152:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781966.344159:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781966.344163:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787781966.344163:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781966.344164:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963018496:12345-0@lo:400:kworker.0 Request processed in 34us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.344170:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787781966.344216:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963018624:0@lo:400:kworker.0 00010000:00080000:1.0:1787781966.344231:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa0c3c0 x1874624963019136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781966.344244:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963019136:0@lo:400:kworker.0 00010000:00080000:1.0:1787781966.344253:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa0d2c0 x1874624963019648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787781966.344489:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781966.344712:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963018880:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.344723:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963018496:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.344733:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963019008:0@lo:400:kworker.0 00000100:00100000:1.0:1787781966.344741:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963019648:0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.344744:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963019520:0@lo:400:kworker.0 00000100:00100000:1.0:1787781966.344769:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963018752:0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.346379:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963019904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.346468:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963019904:12345-0@lo:400:kworker.0 Request processed in 108us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.346552:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963019904:0@lo:400:kworker.0 00000100:00100000:3.0:1787781966.347405:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787781966.347431:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787781966.347450:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781966.347537:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963019392:0@lo:400:kworker.0 00000100:00100000:2.0:1787781966.347624:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963019392:12345-0@lo:400:kworker.0 Request processed in 166us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781966.347631:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787781966.361260:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.361427:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943000064 00000100:00100000:2.0:1787781966.361436:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943000064 00000100:00100000:2.0:1787781966.361492:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:2.0:1787781966.361500:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11185:x1874624943000064:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781966.361522:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781966.361542:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150636fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781966.361654:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787781966.361747:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150636fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839cb expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.361761:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:2.0:1787781966.361764:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781966.361769:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150636fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839cb expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.361782:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781966.361833:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11185:x1874624943000064:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 333us (582us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787781966.361839:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:1.0:1787781966.367406:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.368351:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943000320 00000100:00100000:0.0:1787781966.368363:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943000320 00000100:00100000:0.0:1787781966.368477:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:0.0:1787781966.368489:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11185:x1874624943000320:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781966.368734:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11185:x1874624943000320:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 246us (1335us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787781966.368742:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:0.0:1787781966.500092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781966.500246:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943000448 00000100:00100000:1.0:1787781966.500255:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943000448 00000100:00100000:1.0:1787781966.500323:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:1.0:1787781966.500333:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11191:x1874624943000448:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781966.500361:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781966.500385:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839d2 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500446:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500460:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500471:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781966.500510:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787781966.500514:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781966.500535:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500560:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d2 expref: 20 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500577:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d2 expref: 19 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.500585:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787781966.500588:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781966.500602:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:1.0:1787781966.500830:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11191:x1874624943000448:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 498us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781966.500838:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:1.0:1787781966.511055:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.511168:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943000704 00000100:00100000:2.0:1787781966.511178:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943000704 00000100:00100000:2.0:1787781966.511239:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:2.0:1787781966.511250:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11191:x1874624943000704:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781966.511271:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781966.511293:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063716 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839d9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.511416:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506371d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.511430:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506371d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.511441:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506371d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781966.511452:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787781966.514692:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063716 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d9 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.514718:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506371d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d9 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.514728:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:2.0:1787781966.514731:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781966.514734:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5200, rc 0) 00000100:00100000:2.0:1787781966.514801:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11191:x1874624943000704:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 3553us (3756us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787781966.514810:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:3.0:1787781966.517932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.518154:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943000960 00000100:00100000:0.0:1787781966.518164:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943000960 00000100:00100000:0.0:1787781966.518397:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:0.0:1787781966.518408:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11191:x1874624943000960:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781966.518429:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781966.518448:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c1506372b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781966.518825:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.518895:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001088 00000100:00100000:2.0:1787781966.518900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001088 00000100:00100000:2.0:1787781966.518939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:2.0:1787781966.518946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:2406:x1874624943001088:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781966.518959:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781966.518992:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506371d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d9 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.519010:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:2.0:1787781966.519014:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781966.519078:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:2406:x1874624943001088:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 132us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781966.519087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00010000:00010000:0.0:1787781966.519584:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.519598:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.519622:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781966.519634:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787781966.519730:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c1506372b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e0 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.519745:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e0 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.519765:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:0.0:1787781966.519768:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787781966.519770:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9e00, rc 0) 00000100:00100000:0.0:1787781966.519817:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11191:x1874624943000960:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1411us (1892us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787781966.519824:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:1.0:1787781966.526785:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.526866:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001216 00000100:00100000:0.0:1787781966.526876:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001216 00000100:00100000:0.0:1787781966.526935:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:0.0:1787781966.526944:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943001216:12345-192.168.206.16@tcp:1:lfs.0 00010000:00010000:0.0:1787781966.526985:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.527003:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.527011:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781966.527015:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781966.527019:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.527049:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.527072:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 7 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781966.527102:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963020032:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781966.527190:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43e55c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781966.535894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781966.536052:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001344 00000100:00100000:1.0:1787781966.536070:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001344 00002000:00100000:1.0:1787781966.536115:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff993d413270c0 x1874624943001344/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:112/0 lens 504/0 e 0 to 0 dl 1787781977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781966.536127:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d413270c0 with x1874624943001344 ext(0->12) 00010000:00010000:1.0:1787781966.536136:0:8450:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 8 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.536154:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 8 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781966.536161:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d413270c0 00000100:00100000:0.0:1787781966.536554:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963020032:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781966.536589:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781966.536710:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:1.0:1787781966.536723:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943001344:12345-192.168.206.16@tcp:4:lfs.0 00000001:00100000:2.0:1787781966.538551:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000100:00100000:1.0:1787781966.539420:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943001344:12345-192.168.206.16@tcp:4:lfs.0 Request processed in 2694us (3529us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787781966.539432:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00002000:00100000:1.0:1787781966.539443:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff993d413270c0 x1874624943001344/t4294967300(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:112/0 lens 504/448 e 0 to 0 dl 1787781977 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781966.539469:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d413270c0 with x1874624943001344 ext(0->12) 00010000:00010000:1.0:1787781966.539480:0:8450:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.539497:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781966.539505:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d413270c0 00000100:00100000:1.0:1787781966.542525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.542895:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001472 00000100:00100000:3.0:1787781966.542905:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001472 00010000:00010000:3.0:1787781966.542960:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781966.543003:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:3.0:1787781966.543013:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943001472:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781966.543028:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787781966.543045:0:9533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787781966.543048:0:9533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787781965 00002000:00010000:3.0:1787781966.543051:0:9533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787781966 00002000:00010000:3.0:1787781966.543053:0:9533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787781965 00002000:00010000:3.0:1787781966.543055:0:9533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787781966.543070:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.543084:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.543106:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150636f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839c4 expref: 9 pid: 8446 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.543122:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781966.543127:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781966.543132:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.543151:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.543206:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781966.543260:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943001472:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 248us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.543268:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00010000:00010000:0.0:1787781966.543500:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543512:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543532:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543541:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543548:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543555:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781966.543559:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543593:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543639:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.543648:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15063740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781966.543698:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943001216:12345-192.168.206.16@tcp:1:lfs.0 Request processed in 16754us (16921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.543706:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:0.0:1787781966.546218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.546408:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001728 00000100:00100000:2.0:1787781966.546418:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001728 00000100:00100000:2.0:1787781966.546468:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:2.0:1787781966.546478:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11191:x1874624943001728:12345-192.168.206.16@tcp:35:lfs.0 00000004:00010000:2.0:1787781966.546538:0:6534:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e0 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781966.546812:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787781966.546857:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787781966.547238:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1787781966.547274:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.547288:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 26 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.547297:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.547329:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 26 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.547351:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 26 pid: 10060 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781966.547365:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874624963020160:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781966.547431:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781966.556490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.556574:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001856 00000100:00100000:3.0:1787781966.556583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001856 00010000:00010000:3.0:1787781966.556660:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 27 pid: 10060 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781966.556694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:3.0:1787781966.556706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:2408:x1874624943001856:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781966.556720:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781966.556726:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 27 pid: 10060 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.556739:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 27 pid: 10060 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.556762:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:3.0:1787781966.556767:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.556776:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.556782:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.556813:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781966.556866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:2408:x1874624943001856:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 163us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.556873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00010000:00010000:2.0:1787781966.557202:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150636d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839b6 expref: 26 pid: 10060 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781966.557218:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874624963020160:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781966.557248:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.557256:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.557262:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781966.557369:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787781966.557473:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787781966.557551:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963020288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787781966.557595:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781966.557668:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781966.557799:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963020288 00000100:00100000:1.0:1787781966.557804:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963020288 00000100:00100000:1.0:1787781966.557843:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787781966.557851:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963020288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787781966.557928:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963020288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781966.557934:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787781966.559429:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963020288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787781966.559635:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787781966.559705:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d41326580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963020416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787781966.559824:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781966.559864:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787781966.560224:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963020416 00000100:00100000:0.0:1787781966.560231:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963020416 00000100:00100000:0.0:1787781966.560286:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787781966.560294:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963020416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787781966.560430:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6534:x1874624963020416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (605us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787781966.560438:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787781966.560889:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d41326580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963020416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787781966.560940:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787781966.560978:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.560989:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.560997:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.561003:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781966.561008:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.561015:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.561029:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:3.0:1787781966.561045:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787781966.561052:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.561058:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c15063747 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781966.561178:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787781966.561234:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787781966.561245:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403642637338ns, next at 404642635503ns, rc = 0 00000001:00080000:3.0:1787781966.561251:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1787781966.561274:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528400) 00010000:00010000:3.0:1787781966.561276:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787781966.561283:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063732 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e0 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781966.561375:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:11191:x1874624943001728:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 14899us (15166us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787781966.561384:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 8 00000020:00080000:3.0:1787781966.561388:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787781966.569516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.569833:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943001984 00000100:00100000:2.0:1787781966.569842:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943001984 00000100:00100000:2.0:1787781966.569903:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:2.0:1787781966.569911:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:11191:x1874624943001984:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781966.569948:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781966.569968:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506374e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839e7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.570022:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506374e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e7 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.570036:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506374e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e7 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.570054:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781966.570727:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781966.570735:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781966.570803:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11191:x1874624943001984:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 892us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781966.570811:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:1.0:1787781966.576379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.576657:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943002240 00000100:00100000:0.0:1787781966.576668:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943002240 00000100:00100000:0.0:1787781966.576728:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787781966.576737:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11191:x1874624943002240:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781966.577403:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+31:11191:x1874624943002240:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 663us (1038us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787781966.577428:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787781966.681570:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781966.681735:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943002496 00000100:00100000:1.0:1787781966.681745:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943002496 00000100:00100000:1.0:1787781966.681811:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787781966.681821:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+31:11201:x1874624943002496:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781966.681844:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781966.681866:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839ee expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781966.681976:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787781966.682087:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063755 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839ee expref: 33 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.682100:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:1.0:1787781966.682103:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781966.682108:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839ee expref: 33 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781966.682120:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfba00, rc 0) 00000100:00100000:1.0:1787781966.682184:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11201:x1874624943002496:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 364us (622us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1787781966.682191:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787781966.685247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.685359:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943002624 00000100:00100000:0.0:1787781966.685369:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943002624 00000100:00100000:0.0:1787781966.685430:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:0.0:1787781966.685439:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11201:x1874624943002624:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:0.0:1787781966.685514:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685533:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685544:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685555:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685562:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685567:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685829:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685839:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685846:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781966.685913:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685925:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685932:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685938:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685944:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781966.685948:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685958:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685969:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781966.685971:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781966.685975:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.685981:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063763 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686088:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686093:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686105:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686110:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781966.686113:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686119:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686128:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:0.0:1787781966.686130:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781966.686134:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686139:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c1506376a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686149:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686155:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686162:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686167:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781966.686170:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686186:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686194:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781966.686196:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781966.686199:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781966.686205:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063771 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781966.686318:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11201:x1874624943002624:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 878us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781966.686326:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:2.0:1787781966.688927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.689070:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943002880 00000100:00100000:3.0:1787781966.689079:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943002880 00000100:00100000:3.0:1787781966.689168:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:3.0:1787781966.689178:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11201:x1874624943002880:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:3.0:1787781966.689397:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:11201:x1874624943002880:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 221us (478us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787781966.689406:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:1.0:1787781966.741965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781966.742542:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943003136 00000100:00100000:2.0:1787781966.742551:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943003136 00000100:00100000:2.0:1787781966.742640:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:2.0:1787781966.742713:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:11204:x1874624943003136:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781966.742740:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781966.742919:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063778 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839f5 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.742996:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743030:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743041:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743055:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743071:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743078:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743182:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743191:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743199:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781966.743208:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787781966.743282:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743290:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743296:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743309:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781966.743313:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743321:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743332:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781966.743335:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781966.743340:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743347:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c1506377f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743594:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743603:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743877:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743882:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781966.743885:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743893:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743913:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:2.0:1787781966.743916:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781966.743919:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743925:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063786 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743965:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 36 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743979:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 35 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781966.743986:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781966.743988:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781966.743990:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5200, rc 0) 00000100:00100000:2.0:1787781966.744055:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11204:x1874624943003136:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1406us (2101us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787781966.744075:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:1.0:1787781966.748845:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781966.749291:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943003264 00000100:00100000:3.0:1787781966.749308:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943003264 00000100:00100000:3.0:1787781966.749371:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:3.0:1787781966.749381:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11204:x1874624943003264:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:3.0:1787781966.749447:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749464:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749475:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749513:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749531:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749539:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749546:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781966.749550:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749558:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749570:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781966.749573:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781966.749577:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781966.749594:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506379b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781966.749694:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11204:x1874624943003264:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 314us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.749702:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:1.0:1787781966.752377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781966.752790:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943003520 00000100:00100000:0.0:1787781966.752800:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943003520 00000100:00100000:0.0:1787781966.752847:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:0.0:1787781966.752856:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11204:x1874624943003520:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781966.753274:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:11204:x1874624943003520:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 417us (904us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787781966.753283:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:1.0:1787781966.854208:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781966.854233:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963020544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781966.854299:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781966.854521:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963020544 00000100:00100000:3.0:1787781966.854529:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963020544 00000100:00100000:3.0:1787781966.854584:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787781966.854593:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963020544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781966.854642:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781966.854695:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963020544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781966.854702:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787781966.854725:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963020544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781966.855750:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781966.855801:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781966.855902:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963020672 00000100:00100000:1.0:1787781966.855908:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963020672 00000100:00100000:1.0:1787781966.855951:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787781966.855959:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963020672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781966.855974:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781966.856024:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963020672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781966.856045:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787781966.856218:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963020672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787781966.918377:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781967.054678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.054852:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943003776 00000100:00100000:0.0:1787781967.054863:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943003776 00000100:00100000:0.0:1787781967.054940:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:0.0:1787781967.054951:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:11235:x1874624943003776:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:0.0:1787781967.054973:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781967.054991:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c150637a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb839fc expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.055281:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.055296:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.055320:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781967.055329:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787781967.055567:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c150637a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839fc expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.055588:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839fc expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.055596:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.055599:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781967.055602:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781967.055776:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11235:x1874624943003776:12345-192.168.206.16@tcp:101:cat.0 Request processed in 827us (1108us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787781967.055784:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00080000:1.0:1787781967.056384:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781967.063764:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781967.063810:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.063957:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004160 00000100:00100000:0.0:1787781967.063966:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004160 00000100:00100000:0.0:1787781967.064038:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787781967.064047:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:2408:x1874624943004160:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781967.064075:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781967.064113:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839fc expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.064132:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.064137:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781967.064182:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:2408:x1874624943004160:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.064190:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:3.0:1787781967.065204:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004032 00000100:00100000:3.0:1787781967.065213:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004032 00000100:00100000:3.0:1787781967.065264:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:3.0:1787781967.065271:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:11235:x1874624943004032:12345-192.168.206.16@tcp:35:cat.0 00000100:00100000:3.0:1787781967.066035:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11235:x1874624943004032:12345-192.168.206.16@tcp:35:cat.0 Request processed in 760us (2429us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787781967.066045:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:1.0:1787781967.158769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781967.158936:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004416 00000100:00100000:3.0:1787781967.158946:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004416 00000100:00100000:3.0:1787781967.159028:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:3.0:1787781967.159040:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11241:x1874624943004416:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:3.0:1787781967.160450:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781967.160454:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787781967.160486:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506370f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839d2 expref: 38 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160507:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781967.160512:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781967.160537:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150637b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a03 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160683:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160698:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 38 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160707:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160768:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 38 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.160783:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 38 pid: 10060 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781967.160798:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963020800:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781967.160896:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787781967.163912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.163999:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004544 00000100:00100000:0.0:1787781967.164008:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004544 00010000:00010000:0.0:1787781967.164190:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 39 pid: 10060 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781967.164241:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:0.0:1787781967.164252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:2408:x1874624943004544:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781967.164268:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781967.164275:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 39 pid: 10060 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.164289:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 39 pid: 10060 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.164413:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.164419:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.164430:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.164457:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.164477:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781967.164532:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:2408:x1874624943004544:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 282us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.164539:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00010000:00010000:3.0:1787781967.165535:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c1506378d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839f5 expref: 38 pid: 10060 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781967.165570:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963020800:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781967.165590:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.165600:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.165634:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781967.165655:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787781967.165801:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150637b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.165818:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.165827:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781967.165830:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781967.165833:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705a00, rc 0) 00000100:00100000:3.0:1787781967.165873:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11241:x1874624943004416:12345-192.168.206.16@tcp:101:dd.0 Request processed in 6836us (7115us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787781967.165881:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:1.0:1787781967.172378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.173179:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004672 00000100:00100000:0.0:1787781967.173190:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004672 00000100:00100000:0.0:1787781967.173258:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:0.0:1787781967.173269:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11241:x1874624943004672:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:0.0:1787781967.173295:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781967.173330:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a0a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173364:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173378:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173390:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173517:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173546:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.173562:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.173565:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781967.173569:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9400, rc 0) 00000100:00100000:0.0:1787781967.174926:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:11241:x1874624943004672:12345-192.168.206.16@tcp:101:dd.0 Request processed in 1651us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.174936:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:1.0:1787781967.181827:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.181911:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943004928 00000100:00100000:0.0:1787781967.181922:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943004928 00000100:00100000:0.0:1787781967.181983:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:0.0:1787781967.181992:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:11241:x1874624943004928:12345-192.168.206.16@tcp:36:dd.0 00010000:00010000:0.0:1787781967.182227:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.182244:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.182255:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781967.182322:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787781967.182346:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e17096ee reply state 000000007fae00e7 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.182359:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.182366:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.182369:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781967.182379:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781967.182469:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:11241:x1874624943004928:12345-192.168.206.16@tcp:36:dd.0 Request processed in 477us (650us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787781967.182477:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 62 00000020:00080000:0.0:1787781967.182481:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787781967.238442:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781967.238491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781967.238521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781967.238557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781967.238640:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005312 00000100:00100000:3.0:1787781967.238650:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005312 00000100:00100000:3.0:1787781967.238715:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005184 00000100:00100000:3.0:1787781967.238719:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005184 00000100:00100000:3.0:1787781967.238752:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005440 00000100:00100000:3.0:1787781967.238754:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005440 00000100:00100000:3.0:1787781967.238770:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 288 00000100:00100000:3.0:1787781967.238779:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943005312:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781967.238848:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943005312:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.238856:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 288 00000100:00100000:3.0:1787781967.238873:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 289 00000100:00100000:3.0:1787781967.238880:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943005184:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781967.238902:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943005184:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.238908:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 289 00000100:00100000:3.0:1787781967.238919:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 290 00000100:00100000:3.0:1787781967.238925:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943005440:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781967.238961:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943005440:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.238968:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 290 00000100:00080000:1.0:1787781967.239182:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781967.239187:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781967.239771:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005056 00000100:00100000:0.0:1787781967.239778:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005056 00000100:00100000:0.0:1787781967.239829:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 379 00000100:00100000:0.0:1787781967.239837:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943005056:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781967.240052:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943005056:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 214us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.240077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 379 00000100:00100000:0.0:1787781967.365961:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963020928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781967.366044:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781967.366406:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963020928 00000100:00100000:1.0:1787781967.366414:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963020928 00000100:00100000:1.0:1787781967.366460:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787781967.366468:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963020928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781967.366494:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781967.366553:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963020928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781967.366560:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787781967.366677:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963020928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781967.367436:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963021056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787781967.367504:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781967.367886:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963021056 00000100:00100000:0.0:1787781967.367894:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963021056 00000100:00100000:0.0:1787781967.367942:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787781967.367951:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963021056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781967.367969:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781967.368411:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963021056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.368421:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787781967.368511:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963021056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781967.513561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781967.513798:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005568 00000100:00100000:3.0:1787781967.513809:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005568 00000100:00100000:3.0:1787781967.513881:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:3.0:1787781967.513891:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:11255:x1874624943005568:12345-192.168.206.16@tcp:101:stat.0 00010000:00010000:3.0:1787781967.513914:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781967.513933:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150637e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a11 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514029:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514043:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514063:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514074:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514081:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514087:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514506:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514519:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514527:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514561:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.514588:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 43 pid: 6531 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781967.514602:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963021184:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781967.515407:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787781967.537342:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963021184:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781967.537376:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781967.539312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.540686:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005824 00000100:00100000:0.0:1787781967.540701:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005824 00000100:00100000:0.0:1787781967.540772:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787781967.540782:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:6190:x1874624943005824:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787781967.541124:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:6190:x1874624943005824:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 342us (1828us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787781967.541133:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:2.0:1787781967.550427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.550575:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943005952 00000100:00100000:0.0:1787781967.550585:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943005952 00010000:00010000:0.0:1787781967.550863:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 45 pid: 6531 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781967.550946:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:0.0:1787781967.550957:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:2408:x1874624943005952:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781967.550975:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781967.550983:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 45 pid: 6531 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.550996:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 45 pid: 6531 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.551027:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150637be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a03 expref: 45 pid: 6531 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.551043:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.551048:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.551072:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.551081:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.551133:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781967.551185:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:2408:x1874624943005952:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 229us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.551193:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 56 00010000:00010000:3.0:1787781967.551324:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551333:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781967.551382:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787781967.551386:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781967.551425:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551437:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551446:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551452:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551469:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551475:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781967.551478:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.551486:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552208:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781967.552216:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781967.552223:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552239:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150637e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552254:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552260:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552266:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552272:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781967.552275:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552295:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552306:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:3.0:1787781967.552308:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781967.552311:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552317:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c150637ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552354:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150637e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a11 expref: 44 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552367:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a11 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.552373:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781967.552375:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781967.552377:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704e00, rc 0) 00000100:00100000:3.0:1787781967.552481:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:11255:x1874624943005568:12345-192.168.206.16@tcp:101:stat.0 Request processed in 38591us (38929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.552490:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:1.0:1787781967.606752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781967.607022:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943006208 00000100:00100000:2.0:1787781967.607037:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943006208 00000100:00100000:2.0:1787781967.607128:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:2.0:1787781967.607140:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:11261:x1874624943006208:12345-192.168.206.16@tcp:36:truncate.0 00010000:00010000:2.0:1787781967.607214:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781967.607246:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150637f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a11 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.607271:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781967.607277:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781967.607506:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.607524:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.607536:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781967.608182:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1787781967.608211:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142b2c80 reply state 0000000099afe0aa transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.608226:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.608255:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781967.608258:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781967.608261:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781967.608412:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:11261:x1874624943006208:12345-192.168.206.16@tcp:36:truncate.0 Request processed in 1272us (1676us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787781967.608421:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00000020:00080000:2.0:1787781967.608427:0:10060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787781967.738142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.738265:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943006336 00000100:00100000:0.0:1787781967.738278:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943006336 00000100:00100000:0.0:1787781967.738350:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:0.0:1787781967.738544:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:11275:x1874624943006336:12345-192.168.206.16@tcp:101:stat.0 00010000:00010000:0.0:1787781967.738577:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781967.738695:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a18 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738787:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738805:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738822:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738836:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738844:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.738852:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739080:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739090:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739097:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781967.739149:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787781967.739154:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781967.739180:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739193:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739202:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739209:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739277:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739284:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781967.739289:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739297:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739318:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781967.739321:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781967.739327:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739334:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c1506380b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739349:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739356:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739442:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739448:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781967.739451:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739458:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739467:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:0.0:1787781967.739470:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781967.739473:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739479:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063812 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739522:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063804 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 47 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739538:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.739545:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.739548:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781967.739550:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167600, rc 0) 00000100:00100000:0.0:1787781967.739884:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+46:11275:x1874624943006336:12345-192.168.206.16@tcp:101:stat.0 Request processed in 1523us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.739893:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:0.0:1787781967.821180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781967.823724:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943006592 00000100:00100000:2.0:1787781967.823740:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943006592 00000100:00100000:2.0:1787781967.823816:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:2.0:1787781967.823826:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+46:11285:x1874624943006592:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781967.823847:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781967.823869:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a1f expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781967.824178:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787781967.824302:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a1f expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.824331:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:2.0:1787781967.824334:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781967.824339:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a1f expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.824354:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4800, rc 0) 00000100:00100000:2.0:1787781967.824467:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:11285:x1874624943006592:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 642us (3296us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1787781967.824491:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:1.0:1787781967.832515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.833318:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943006848 00000100:00100000:0.0:1787781967.833329:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943006848 00000100:00100000:0.0:1787781967.833392:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:0.0:1787781967.833403:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:11285:x1874624943006848:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781967.833635:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+48:11285:x1874624943006848:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 233us (1128us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787781967.833644:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:1.0:1787781967.934855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781967.935015:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943007104 00000100:00100000:3.0:1787781967.935044:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943007104 00000100:00100000:3.0:1787781967.935133:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:3.0:1787781967.935144:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+48:11291:x1874624943007104:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781967.935194:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781967.935223:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506382e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a26 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.935369:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.935387:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 49 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.935397:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.935442:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 49 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.935457:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 49 pid: 6531 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781967.935471:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963021312:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781967.935660:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787781967.939819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781967.939921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943007232 00000100:00100000:2.0:1787781967.939935:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943007232 00010000:00010000:2.0:1787781967.939982:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 50 pid: 6531 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781967.940017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:2.0:1787781967.940026:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:2409:x1874624943007232:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781967.940040:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781967.940047:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 50 pid: 6531 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.940069:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 50 pid: 6531 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.940093:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781967.940098:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.940118:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.940126:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.940146:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781967.940211:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:2409:x1874624943007232:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 185us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781967.940239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00010000:00010000:0.0:1787781967.941727:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781967.942595:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a18 expref: 49 pid: 6531 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781967.942722:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa77840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963021312:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781967.942753:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.942786:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.943855:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781967.943885:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787781967.944487:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506382e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.944508:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.944518:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781967.944521:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781967.944524:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704600, rc 0) 00000100:00100000:3.0:1787781967.944868:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:11291:x1874624943007104:12345-192.168.206.16@tcp:101:bash.0 Request processed in 9724us (10019us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787781967.944878:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:1.0:1787781967.956333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.956434:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943007488 00000100:00100000:0.0:1787781967.956446:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943007488 00000100:00100000:0.0:1787781967.956522:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:0.0:1787781967.956546:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:11291:x1874624943007488:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:0.0:1787781967.956895:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.956916:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.956929:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781967.956993:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787781967.960482:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0022c7b reply state 000000007f8986a0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.960525:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.960547:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781967.960550:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781967.960556:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781967.960782:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:11291:x1874624943007488:12345-192.168.206.16@tcp:36:bash.0 Request processed in 4244us (4455us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787781967.960792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 68 00000020:00080000:0.0:1787781967.960799:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787781967.973241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.973417:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943007616 00000100:00100000:0.0:1787781967.973430:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943007616 00000100:00100000:0.0:1787781967.973503:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:0.0:1787781967.973514:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:11291:x1874624943007616:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781967.973889:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781967.973917:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506384a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a2d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.974233:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.974251:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.974260:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.974298:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.974313:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 53 pid: 6533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781967.974328:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963021440:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781967.974433:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43e55d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781967.980050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.980552:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963021440:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781967.980590:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781967.981242:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943007744 00000100:00100000:2.0:1787781967.981252:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943007744 00010000:00010000:2.0:1787781967.981301:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 54 pid: 6533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781967.981353:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:2.0:1787781967.981364:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:2409:x1874624943007744:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781967.981382:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781967.981390:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 54 pid: 6533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981405:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 54 pid: 6533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981432:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063835 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a26 expref: 54 pid: 6533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981451:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781967.981456:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981467:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981476:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.981532:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781967.981603:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:2409:x1874624943007744:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 240us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781967.981662:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 58 00010000:00010000:3.0:1787781967.982458:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.982470:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781967.982551:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787781967.982556:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781967.982581:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.982762:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506384a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a2d expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.982786:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a2d expref: 52 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781967.982795:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781967.982798:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781967.982801:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:3.0:1787781967.982921:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:11291:x1874624943007616:12345-192.168.206.16@tcp:101:bash.0 Request processed in 9408us (9692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.982930:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:1.0:1787781967.996819:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781967.996989:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943008000 00000100:00100000:0.0:1787781967.997002:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943008000 00000100:00100000:0.0:1787781967.997081:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:0.0:1787781967.997093:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:11291:x1874624943008000:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:0.0:1787781967.997371:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11291:x1874624943008000:12345-192.168.206.16@tcp:35:bash.0 Request processed in 280us (776us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787781967.997392:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 15 00000040:00080000:2.0:1787781968.006466:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787781968.007253:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787781968.096276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781968.096866:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943008256 00000100:00100000:2.0:1787781968.096879:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943008256 00000100:00100000:2.0:1787781968.096959:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:2.0:1787781968.096970:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11301:x1874624943008256:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781968.097000:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781968.097155:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a34 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781968.097277:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787781968.097403:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063858 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a34 expref: 55 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.097421:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:2.0:1787781968.097425:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781968.097431:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a34 expref: 55 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.097450:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4800, rc 0) 00000100:00100000:2.0:1787781968.097534:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11301:x1874624943008256:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 565us (1271us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787781968.097542:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:1.0:1787781968.102463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781968.102565:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943008384 00000100:00100000:3.0:1787781968.102577:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943008384 00000100:00100000:3.0:1787781968.102698:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 71 00000100:00100000:3.0:1787781968.102711:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11301:x1874624943008384:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:3.0:1787781968.102819:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102840:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102855:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102867:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102896:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102904:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.102991:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103002:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103009:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781968.103079:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103096:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103104:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103112:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103120:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781968.103124:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103134:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103157:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781968.103161:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781968.103167:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103175:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063866 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103193:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103200:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103207:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103214:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781968.103218:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103226:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103237:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:3.0:1787781968.103240:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781968.103244:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103366:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506386d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103391:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103398:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103405:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103411:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781968.103415:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103422:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103435:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781968.103438:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781968.103442:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781968.103449:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781968.103554:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11301:x1874624943008384:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 842us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781968.103565:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 71 00000100:00100000:1.0:1787781968.108185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781968.108816:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943008640 00000100:00100000:3.0:1787781968.108832:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943008640 00000100:00100000:3.0:1787781968.109143:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:3.0:1787781968.109173:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11301:x1874624943008640:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:3.0:1787781968.110130:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:11301:x1874624943008640:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 953us (1961us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787781968.110142:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:0.0:1787781968.191913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781968.194393:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943008896 00000100:00100000:1.0:1787781968.194416:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943008896 00000100:00100000:1.0:1787781968.194514:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:1.0:1787781968.194526:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:11304:x1874624943008896:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781968.194559:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781968.194586:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506387b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a3b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194748:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194765:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194777:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194789:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194814:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194822:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194958:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063890 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194967:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.194976:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781968.194987:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787781968.195091:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195099:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195105:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195111:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfba00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781968.195115:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195123:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195148:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787781968.195151:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781968.195157:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195163:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195179:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195185:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195191:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195196:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781968.195199:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195205:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195211:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:1.0:1787781968.195214:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781968.195216:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195772:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063889 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195846:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506387b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a3b expref: 58 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195862:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a3b expref: 57 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781968.195871:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:1.0:1787781968.195873:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781968.195876:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787781968.195975:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11304:x1874624943008896:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1449us (4075us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787781968.195984:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:1.0:1787781968.201527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781968.201648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781968.201651:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943009024 00000100:00100000:0.0:1787781968.201670:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943009024 00000100:00100000:0.0:1787781968.201761:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:0.0:1787781968.201774:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11304:x1874624943009024:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:0.0:1787781968.201859:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201880:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201893:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201936:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201943:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201950:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201956:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781968.201961:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.201969:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.202003:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781968.202007:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781968.202014:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.202021:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506389e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781968.202178:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11304:x1874624943009024:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 406us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781968.202187:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:3.0:1787781968.202784:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943009152 00000100:00100000:3.0:1787781968.202795:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943009152 00000100:00100000:0.0:1787781968.203186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:0.0:1787781968.203196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:2409:x1874624943009152:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781968.203212:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781968.203246:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063890 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a3b expref: 57 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.203265:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781968.203269:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781968.203309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:2409:x1874624943009152:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 114us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781968.203316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:3.0:1787781968.218308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781968.218446:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943009408 00000100:00100000:2.0:1787781968.218456:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943009408 00000100:00100000:2.0:1787781968.218576:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:2.0:1787781968.218588:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:11304:x1874624943009408:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781968.218921:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11304:x1874624943009408:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 335us (620us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787781968.218930:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:0.0:1787781968.376009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781968.380698:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943009664 00000100:00100000:2.0:1787781968.380715:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943009664 00000100:00100000:2.0:1787781968.380794:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:2.0:1787781968.380804:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11322:x1874624943009664:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:2.0:1787781968.380829:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781968.380848:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150638a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a42 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.381583:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150638ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.381599:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150638ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.381756:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150638ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781968.381768:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787781968.382945:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150638a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a42 expref: 60 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.382974:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150638ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a42 expref: 59 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.382995:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781968.382998:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787781968.383001:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4200, rc 0) 00000100:00100000:2.0:1787781968.383226:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:11322:x1874624943009664:12345-192.168.206.16@tcp:101:cat.0 Request processed in 2421us (7223us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787781968.383234:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:1.0:1787781968.417701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781968.417850:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943009792 00000100:00100000:0.0:1787781968.417860:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943009792 00000100:00100000:0.0:1787781968.417928:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:0.0:1787781968.417937:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:11323:x1874624943009792:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781968.417977:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781968.417998:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a49 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418073:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418088:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418108:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781968.418151:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787781968.418155:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781968.418173:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418198:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a49 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418217:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a49 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.418225:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781968.418228:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781968.418231:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167200, rc 0) 00000100:00100000:0.0:1787781968.418291:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11323:x1874624943009792:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 355us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781968.418298:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:1.0:1787781968.425179:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781968.425987:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010176 00000100:00100000:0.0:1787781968.425998:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010176 00000100:00100000:0.0:1787781968.426072:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787781968.426081:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11323:x1874624943010176:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781968.426543:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11323:x1874624943010176:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 461us (1370us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787781968.426551:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:1.0:1787781968.434464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781968.434551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010304 00000100:00100000:2.0:1787781968.434561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010304 00000100:00100000:2.0:1787781968.434655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:2.0:1787781968.434665:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11323:x1874624943010304:12345-192.168.206.16@tcp:103:lfs.0 00010000:00010000:2.0:1787781968.434681:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787781968.434705:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a2d expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.434726:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150638ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a42 expref: 60 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.434740:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506374e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839e7 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781968.434750:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781968.434754:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781968.434805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11323:x1874624943010304:12345-192.168.206.16@tcp:103:lfs.0 Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781968.434813:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:1.0:1787781968.441750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781968.441841:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010432 00000100:00100000:0.0:1787781968.441851:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010432 00000100:00100000:0.0:1787781968.441951:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:0.0:1787781968.441961:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11323:x1874624943010432:12345-192.168.206.16@tcp:58:lfs.0 00010000:00010000:0.0:1787781968.442078:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.443153:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.443172:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781968.443432:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781968.443565:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787781968.443669:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787781968.443779:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11323:x1874624943010432:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 1816us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781968.443788:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:1.0:1787781968.462863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781968.463017:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010560 00000100:00100000:0.0:1787781968.463027:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010560 00000100:00100000:0.0:1787781968.463095:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 77 00000100:00100000:0.0:1787781968.463124:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11325:x1874624943010560:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781968.463144:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781968.463164:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c150638cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a50 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463226:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463242:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463252:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463265:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463271:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463278:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463349:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463358:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463365:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781968.463430:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787781968.463434:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781968.463452:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463464:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463471:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463477:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463484:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463490:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781968.463494:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463502:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463513:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781968.463516:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781968.463520:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463525:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c150638d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463548:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463555:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463561:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463566:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781968.463569:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463575:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463583:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:0.0:1787781968.463585:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781968.463588:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463594:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c150638dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463674:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c150638cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463688:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781968.463709:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:0.0:1787781968.463711:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781968.463714:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166a00, rc 0) 00000100:00100000:0.0:1787781968.463764:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:11325:x1874624943010560:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 643us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781968.463771:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 77 00010000:00010000:3.0:1787781968.968891:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781969.033042:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781969.033058:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781969.033105:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787781969.033112:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781969.033381:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963021568:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781969.033690:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433540 going to sleep for 11 seconds 00000100:00100000:3.0:1787781969.039984:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963021568:192.168.206.16@tcp:107:hsm_cdtr.0 00000001:00080000:2.0:1787781969.046344:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1787781969.046408:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787781969.046426:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d772fd780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787781969.046431:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d4721b600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d772fde40 00000020:00080000:2.0:1787781969.046434:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d4721b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993d80acfe00 00000100:00100000:2.0:1787781969.046558:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781969.046577:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963021696:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787781969.046719:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046731:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046739:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046746:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.046751:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046759:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046775:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff993c436a7a00) 00010000:00010000:3.0:1787781969.046779:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.046784:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046803:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506368a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046825:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046832:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046838:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046843:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.046845:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046851:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046861:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781969.046863:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.046866:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046871:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063691 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046883:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046889:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046902:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046907:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfaa00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.046910:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046916:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046925:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528e00) 00010000:00010000:3.0:1787781969.046927:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.046930:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046936:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c150636d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046952:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046958:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046963:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046968:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.046971:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046987:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.046996:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.046999:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.047002:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047008:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c150637da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047020:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047026:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047032:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047037:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.047040:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047058:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047066:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.047069:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.047072:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047096:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150637fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047108:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047113:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047119:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047124:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.047128:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047133:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047141:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.047143:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.047145:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.047151:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063843 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.047337:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787781969.047724:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787781969.047901:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787781969.047981:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963021696 00000100:00100000:3.0:1787781969.047989:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963021696 00000100:00100000:3.0:1787781969.048040:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781969.048061:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963021696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787781969.048160:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1787781969.048190:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f634d, atime: 0x6a8f634e, ctime: 0x6a8f634d, blocks: 0x8 00010000:00010000:3.0:1787781969.048198:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048213:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1787781969.048217:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781969.048223:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048237:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048245:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048253:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048270:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781969.048395:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963021696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 346us (1058us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787781969.048403:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787781969.048428:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781969.048433:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048450:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781969.048454:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048462:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048477:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048484:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000679edef0/0xc6d6745c150638eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.048498:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781969.048500:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781969.048501:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787781969.048528:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43e43840/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787781969.048533:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963021696:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787781969.049255:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781969.050747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.050831:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010688 00000100:00100000:2.0:1787781969.050840:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010688 00000100:00100000:2.0:1787781969.050916:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 78 00000100:00100000:2.0:1787781969.050927:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11336:x1874624943010688:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781969.050957:0:10060:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781969.051076:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11336:x1874624943010688:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 151us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.051084:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 78 00000100:00080000:1.0:1787781969.051527:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781969.063598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781969.063735:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943010816 00000100:00100000:1.0:1787781969.063744:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943010816 00000100:00100000:1.0:1787781969.063805:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 79 00000100:00100000:1.0:1787781969.063815:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11336:x1874624943010816:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787781969.063894:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063911:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063923:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063958:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063966:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063972:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.063999:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064007:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064014:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.064067:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787781969.064071:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781969.064085:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064104:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064116:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064122:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064128:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781969.064133:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064140:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064153:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:1.0:1787781969.064156:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.064160:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064166:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150638f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064179:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064185:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064190:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064195:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781969.064204:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064221:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064229:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff993c42528f00) 00010000:00010000:1.0:1787781969.064232:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.064235:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064240:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c150638f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064255:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064261:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064266:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064271:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbc00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781969.064273:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064279:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064286:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:1.0:1787781969.064288:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.064297:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.064303:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c15063900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.064367:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11336:x1874624943010816:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 Request processed in 553us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.064374:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 79 00000100:00100000:1.0:1787781969.067063:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.067202:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943011072 00000100:00100000:3.0:1787781969.067211:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943011072 00000100:00100000:3.0:1787781969.067268:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 80 00000100:00100000:3.0:1787781969.067278:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11336:x1874624943011072:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.067298:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.067317:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063907 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a57 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067424:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067437:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067447:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781969.067456:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787781969.067531:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067538:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067545:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067551:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.067554:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067561:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067572:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.067575:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781969.067580:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067596:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506390e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067662:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063907 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a57 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067672:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:3.0:1787781969.067675:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781969.067678:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063907 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a57 expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.067687:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704c00, rc 0) 00000100:00100000:3.0:1787781969.067737:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011072:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 461us (692us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787781969.067744:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 80 00000100:00100000:1.0:1787781969.070782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781969.070846:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943011200 00000100:00100000:0.0:1787781969.070855:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943011200 00000100:00100000:0.0:1787781969.070909:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:0.0:1787781969.070923:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011200:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787781969.070957:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787781969.071211:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011200:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 291us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781969.071220:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:1.0:1787781969.077211:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.077331:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943011456 00000100:00100000:3.0:1787781969.077341:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943011456 00000100:00100000:3.0:1787781969.077428:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:3.0:1787781969.077437:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011456:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.077455:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.077458:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787781969.077481:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c150638c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a49 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.077495:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781969.077500:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781969.077519:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c1506391c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a5e expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781969.077910:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787781969.078084:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063923 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.078097:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.078107:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.078157:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c1506391c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a5e expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.078170:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063923 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a5e expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.078178:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993d6d097a00) 00010000:00010000:3.0:1787781969.078180:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781969.078183:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781969.078238:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943011456:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 802us (1038us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787781969.078254:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:1.0:1787781969.086311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.086505:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943011712 00000100:00100000:3.0:1787781969.086522:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943011712 00000100:00100000:3.0:1787781969.086633:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 83 00000100:00100000:3.0:1787781969.086648:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943011712:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.090228:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781969.090330:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063923 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a5e expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090348:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993d6d097a00) 00010000:00010000:3.0:1787781969.090358:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781969.090380:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090394:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090403:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090461:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090470:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090477:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090523:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090531:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090625:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090642:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.090646:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090653:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090662:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781969.090666:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.090669:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090675:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063931 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090686:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090692:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090697:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090703:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.090705:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090711:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090731:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa2794641 (ffff993d6d097f00) 00010000:00010000:3.0:1787781969.090733:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.090736:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.090742:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063938 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa2794641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.090836:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011712:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 4192us (4529us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787781969.090845:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 83 00000100:00100000:3.0:1787781969.098180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.098738:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943011840 00000100:00100000:2.0:1787781969.098750:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943011840 00000100:00100000:2.0:1787781969.098816:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 84 00000100:00100000:2.0:1787781969.098826:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11336:x1874624943011840:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781969.098844:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781969.098866:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506393f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099119:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099133:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099145:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099244:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506393f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099335:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.099344:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:2.0:1787781969.099348:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781969.099351:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5000, rc 0) 00000100:00100000:2.0:1787781969.099452:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943011840:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 626us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.099460:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 84 00000100:00100000:1.0:1787781969.102685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781969.103254:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012096 00000100:00100000:0.0:1787781969.103269:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012096 00000100:00100000:0.0:1787781969.103374:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 85 00000100:00100000:0.0:1787781969.103386:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943012096:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781969.103465:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.103484:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.103496:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781969.103741:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787781969.103751:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406185142904ns, next at 407185140294ns, rc = 0 00000004:00010000:0.0:1787781969.103805:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf59e5d0 reply state 000000004f0ff224 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.103819:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.103826:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:0.0:1787781969.103829:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787781969.103833:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781969.103949:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11336:x1874624943012096:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 564us (1278us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787781969.103956:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 85 00000100:00100000:1.0:1787781969.107381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.108347:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012224 00000100:00100000:3.0:1787781969.108365:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012224 00000100:00100000:3.0:1787781969.108492:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 86 00000100:00100000:3.0:1787781969.108504:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11336:x1874624943012224:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.108537:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.108563:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a6c expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.108680:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 17 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.108704:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 17 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.108728:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781969.108750:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781969.108755:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705000, rc 0) 00000100:00100000:3.0:1787781969.108826:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11336:x1874624943012224:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 325us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.108834:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 86 00000100:00100000:1.0:1787781969.128155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.129410:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012352 00000100:00100000:2.0:1787781969.129424:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012352 00000100:00100000:2.0:1787781969.129503:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:2.0:1787781969.129511:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1874624943012352:12345-192.168.206.16@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787781969.129545:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:2.0:1787781969.129576:0:8446:0:(genops.c:1385:class_connect()) connect: client cd0eda9e-1cb2-4b8a-8952-0f785606e4c5, cookie 0xc6d6745c1506395b 00002000:00100000:2.0:1787781969.129595:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd0eda9e-1cb2-4b8a-8952-0f785606e4c5/ffff993d454b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787781969.129649:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787781969.130338:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787781969.130370:0:8446:0:(import.c:65:import_set_state_nolock()) ffff993c43d1c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781969.130442:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2405:x1874624943012352:12345-192.168.206.16@tcp:8:lhsmtool_posix.0 Request processed in 929us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.130451:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:0.0:1787781969.138104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.138285:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012480 00000100:00100000:2.0:1787781969.138295:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012480 00000100:00100000:2.0:1787781969.138372:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:2.0:1787781969.138383:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:0:x1874624943012480:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787781969.138402:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787781969.145022:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1787781969.145042:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000100:00100000:1.0:1787781969.145345:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:0:x1874624943012480:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 6958us (7244us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787781969.145356:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:1.0:1787781969.155996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.156071:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012736 00000100:00100000:3.0:1787781969.156087:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012736 00000100:00100000:3.0:1787781969.156163:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:3.0:1787781969.156187:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11336:x1874624943012736:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787781969.156474:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11336:x1874624943012736:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 300us (485us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787781969.156483:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:3.0:1787781969.168243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781969.171071:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943012992 00000100:00100000:0.0:1787781969.171091:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943012992 00000100:00100000:0.0:1787781969.171891:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 87 00000100:00100000:0.0:1787781969.171905:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11336:x1874624943012992:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787781969.172080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11336:x1874624943012992:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 179us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781969.172089:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 87 00000100:00100000:0.0:1787781969.181831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781969.181976:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013120 00000100:00100000:1.0:1787781969.181988:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013120 00000100:00100000:1.0:1787781969.182168:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 88 00000100:00100000:1.0:1787781969.182184:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11336:x1874624943013120:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781969.182233:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781969.182260:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063962 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a73 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182375:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182391:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182402:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.182451:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781969.182472:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182500:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063962 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a73 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182516:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a73 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.182524:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:1.0:1787781969.182527:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781969.182531:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787781969.182599:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11336:x1874624943013120:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 422us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.182631:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 88 00000100:00100000:1.0:1787781969.192217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.192694:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013248 00000100:00100000:3.0:1787781969.192717:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013248 00000100:00100000:3.0:1787781969.192800:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:3.0:1787781969.192813:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943013248:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.192835:0:13830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.192862:0:13830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a7a expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781969.192902:0:13830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6350, blocks: 0x0 00010000:00010000:3.0:1787781969.193191:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1787781969.193197:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781969.193209:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 6 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.193234:0:13830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 6 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.193249:0:13830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704800, rc 0) 00000100:00100000:3.0:1787781969.193320:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943013248:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 511us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.193328:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:2.0:1787781969.198828:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.199020:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013504 00000100:00100000:3.0:1787781969.199032:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013504 00000100:00100000:3.0:1787781969.199119:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 89 00000100:00100000:3.0:1787781969.199132:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11336:x1874624943013504:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781969.199274:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11336:x1874624943013504:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 145us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.199283:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 89 00000100:00100000:2.0:1787781969.204874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.205965:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013632 00000100:00100000:3.0:1787781969.205979:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013632 00000100:00100000:3.0:1787781969.206056:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:3.0:1787781969.206067:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:11336:x1874624943013632:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.206087:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.206247:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a81 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.206299:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 7 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.206309:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781969.206313:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781969.206319:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.206355:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 7 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.206370:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 7 pid: 13830 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.206388:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa77c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8446:1874624963021824:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781969.206496:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781969.212403:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.212445:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013760 00000100:00100000:2.0:1787781969.212455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013760 00010000:00010000:2.0:1787781969.212504:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 8 pid: 13830 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.212546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:2.0:1787781969.212558:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943013760:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781969.212576:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781969.212603:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 8 pid: 13830 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.212671:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 8 pid: 13830 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.212718:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781969.212724:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781969.212733:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.212745:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.212791:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.212810:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d50320780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874624963021952:192.168.206.16@tcp:105: 00000100:00100000:2.0:1787781969.212903:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d43d07cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787781969.213326:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c15063970 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a7a expref: 8 pid: 13830 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.213348:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa77c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8446:1874624963021824:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781969.213378:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.213390:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704c00, rc 0) 00000100:00100000:3.0:1787781969.213451:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11336:x1874624943013632:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 7384us (8589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.213460:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:3.0:1787781969.216722:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d50320780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874624963021952:192.168.206.16@tcp:105: 00010000:00010000:3.0:1787781969.216758:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781969.216826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624943013760:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 4268us (4432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.216841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:2.0:1787781969.219729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.219906:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943013888 00000100:00100000:3.0:1787781969.219918:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943013888 00002000:00100000:3.0:1787781969.220099:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff993d503212c0 x1874624943013888/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:115/0 lens 504/0 e 0 to 0 dl 1787781980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781969.220186:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d503212c0 with x1874624943013888 ext(0->8) 00002000:00010000:3.0:1787781969.220193:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d503212c0 00000100:00100000:3.0:1787781969.220276:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:3.0:1787781969.220289:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943013888:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787781969.223350:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2406:x1874624943013888:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 Request processed in 3050us (3620us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787781969.223366:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00002000:00100000:3.0:1787781969.223382:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff993d503212c0 x1874624943013888/t4294967303(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:115/0 lens 504/448 e 0 to 0 dl 1787781980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781969.223393:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d503212c0 with x1874624943013888 ext(0->8) 00002000:00010000:3.0:1787781969.223403:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d503212c0 00000100:00100000:2.0:1787781969.229913:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.231543:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014016 00000100:00100000:3.0:1787781969.231571:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014016 00000100:00100000:3.0:1787781969.231655:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 90 00000100:00100000:3.0:1787781969.231666:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11336:x1874624943014016:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787781969.234576:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787781969.234601:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787781969.234667:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787781969.234798:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963022080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787781969.234871:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787781969.235021:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.235036:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.235065:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.235072:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781969.235078:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.235087:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787781969.235239:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787781969.235252:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787781969.235274:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963022080 00000100:00100000:1.0:1787781969.235284:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963022080 00000100:00100000:1.0:1787781969.235357:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787781969.235373:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:11336:x1874624943014016:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 Request processed in 3704us (5468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.235373:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963022080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787781969.235401:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 90 00002000:00010000:1.0:1787781969.235544:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787781969.235549:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787781968 00002000:00010000:1.0:1787781969.235552:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787781969.235554:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787781968 -> 1787781968 00002000:00010000:1.0:1787781969.235557:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787781969.235662:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963022080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (790us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787781969.235670:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787781969.235708:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787781969.235766:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:0.0:1787781969.235770:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787781969.235777:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.235786:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c1506394d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781969.236194:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993d7fa77c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787781969.236204:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963022080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787781969.238882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.244158:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014144 00000100:00100000:3.0:1787781969.244179:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014144 00000100:00100000:2.0:1787781969.244344:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:2.0:1787781969.244358:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2407:x1874624943014144:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787781969.254790:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787781969.254809:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787781969.255086:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624943014144:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 Request processed in 10722us (16205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.255100:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:2.0:1787781969.260171:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.261231:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014400 00000100:00100000:3.0:1787781969.261246:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014400 00000100:00100000:3.0:1787781969.261333:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 91 00000100:00100000:3.0:1787781969.261346:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943014400:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.261432:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781969.261464:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a73 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.261489:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781969.261495:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781969.261535:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.261558:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.261577:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781969.261835:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000158051c8 reply state 000000009d92d6d6 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.261849:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.261856:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781969.261859:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781969.261862:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781969.262074:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:11336:x1874624943014400:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 730us (1915us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787781969.262082:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 91 00000100:00100000:2.0:1787781969.267458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.268784:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014528 00000100:00100000:3.0:1787781969.268799:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014528 00000100:00100000:3.0:1787781969.268913:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:3.0:1787781969.268926:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624943014528:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787781969.269947:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787781969.270028:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787781968 -> 1787781967 00002000:00010000:3.0:1787781969.270032:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787781966 00002000:00010000:3.0:1787781969.270034:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787781968 -> 1787781967 00002000:00010000:3.0:1787781969.270037:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787781969.270204:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943014528:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 1277us (2757us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787781969.270226:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:0.0:1787781969.284241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.285098:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014784 00000100:00100000:3.0:1787781969.285116:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014784 00000100:00100000:3.0:1787781969.285196:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 92 00000100:00100000:3.0:1787781969.285208:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:11336:x1874624943014784:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.285294:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.285314:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.285325:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.285367:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.285383:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 15 pid: 6532 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.285399:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963022208:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781969.285523:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781969.290431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781969.290473:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943014912 00000100:00100000:2.0:1787781969.290483:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943014912 00010000:00010000:2.0:1787781969.290533:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 16 pid: 6532 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.290577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:2.0:1787781969.290588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:2409:x1874624943014912:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781969.290636:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781969.290646:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 16 pid: 6532 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.290660:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 16 pid: 6532 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.290688:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:2.0:1787781969.290693:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.290705:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.290713:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.290736:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781969.290796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:2409:x1874624943014912:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 209us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.290804:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 60 00010000:00010000:3.0:1787781969.291101:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063946 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a65 expref: 15 pid: 6532 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.291119:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963022208:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781969.291155:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291165:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291170:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291214:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291222:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291230:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291236:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.291240:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291248:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291258:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781969.291261:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787781969.291265:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.291271:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063985 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.291342:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943014784:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 Request processed in 6136us (7111us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787781969.291350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 92 00000100:00100000:0.0:1787781969.303778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.304154:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015040 00000100:00100000:3.0:1787781969.304167:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015040 00000100:00100000:3.0:1787781969.304231:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:3.0:1787781969.304244:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943015040:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.304294:0:8638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.304317:0:8638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.304327:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781969.304332:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781969.304337:0:8638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.304377:0:8638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.304393:0:8638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 7 pid: 8446 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.304410:0:8638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963022336:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781969.304517:0:8638:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781969.311205:0:8638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963022336:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781969.311243:0:8638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.311294:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781969.311364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015168 00000100:00100000:0.0:1787781969.311372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015168 00010000:00010000:0.0:1787781969.311418:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781969.311481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:0.0:1787781969.311491:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943015168:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781969.311510:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781969.311534:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311547:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311586:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000679edef0/0xc6d6745c15063977 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a81 expref: 8 pid: 8446 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311632:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781969.311637:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781969.311643:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311654:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311680:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781969.311740:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943015168:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 250us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781969.311748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 61 00010000:00010000:0.0:1787781969.311870:0:8638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311879:0:8638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311901:0:8638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311909:0:8638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311917:0:8638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311925:0:8638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781969.311929:0:8638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311938:0:8638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.311950:0:8638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.312144:0:8638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd3ea35/0xc6d6745c1506398c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781969.312218:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624943015040:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 Request processed in 7976us (8453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781969.312227:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:2.0:1787781969.314817:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.314888:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015424 00000100:00100000:3.0:1787781969.314899:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015424 00000100:00100000:3.0:1787781969.314974:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 93 00000100:00100000:3.0:1787781969.314984:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11336:x1874624943015424:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787781969.315088:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.315108:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.315118:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.315159:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.315175:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 14 pid: 6533 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.315190:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022464:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781969.315282:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d490660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781969.325244:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022464:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781969.325286:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.331317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781969.331558:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015552 00000100:00100000:1.0:1787781969.340718:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015552 00010000:00010000:1.0:1787781969.340782:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 15 pid: 6533 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.340838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:1.0:1787781969.340849:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:2408:x1874624943015552:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781969.340865:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781969.340872:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 15 pid: 6533 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.340900:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 15 pid: 6533 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.340928:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150637d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a0a expref: 15 pid: 6533 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.340946:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:1.0:1787781969.340963:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.340974:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.340983:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341130:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781969.341220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2408:x1874624943015552:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 360us (9905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.341228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 62 00010000:00010000:1.0:1787781969.341330:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341340:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341545:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341582:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341591:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341656:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 14 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.341671:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 14 pid: 10060 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.341686:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022592:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781969.341749:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781969.347553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.347594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015680 00000100:00100000:3.0:1787781969.347630:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015680 00010000:00010000:3.0:1787781969.347682:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 15 pid: 10060 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.347721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:3.0:1787781969.347732:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:2408:x1874624943015680:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781969.347748:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781969.347755:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 15 pid: 10060 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.347770:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 15 pid: 10060 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.347795:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781969.347801:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.347811:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.347819:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.347840:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781969.347905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:2408:x1874624943015680:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 173us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.347913:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00010000:00010000:1.0:1787781969.349713:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063954 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a6c expref: 14 pid: 10060 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.349740:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022592:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781969.349769:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.349780:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.349785:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781969.349918:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1787781969.351350:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1787781969.351426:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1787781969.351527:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963022720:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781969.351640:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781969.351692:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781969.351738:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963022720 00000100:00100000:1.0:1787781969.351746:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963022720 00000100:00100000:1.0:1787781969.351802:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787781969.351811:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1874624963022720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781969.351905:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1874624963022720:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.351914:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:3.0:1787781969.352682:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781969.352689:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781969.352728:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787781969.352736:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781969.354325:0:6533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787781969.354337:0:6533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993d7fa77c00, transno 4294967304 00000100:00100000:1.0:1787781969.354368:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963022720:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787781969.355113:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787781969.355205:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963022848:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781969.355289:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781969.355336:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781969.356696:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963022848 00000100:00100000:2.0:1787781969.356711:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963022848 00000100:00100000:2.0:1787781969.356783:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787781969.356795:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6533:x1874624963022848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787781969.357157:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6533:x1874624963022848:12345-0@lo:1000:mdt00_002.0 Request processed in 364us (1866us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787781969.357165:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787781969.357362:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963022848:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787781969.357423:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357434:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357442:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357466:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbe00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781969.357471:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357480:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357498:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:1.0:1787781969.357502:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781969.357506:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357513:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506399a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357548:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.357555:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358820:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358830:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781969.358835:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358843:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358872:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:1.0:1787781969.358876:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781969.358880:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358887:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c150638c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358922:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358939:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.358949:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.359000:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.359142:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 17 pid: 6531 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.359159:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022976:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781969.359308:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d5884e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781969.362295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781969.362399:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963022976:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781969.362428:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.362505:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943015808 00000100:00100000:2.0:1787781969.362512:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943015808 00010000:00010000:2.0:1787781969.362551:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 18 pid: 6531 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.362596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:2.0:1787781969.362628:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2408:x1874624943015808:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781969.362646:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781969.362654:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 18 pid: 6531 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362667:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 18 pid: 6531 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362692:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150638e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a50 expref: 18 pid: 6531 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362708:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:2.0:1787781969.362718:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362728:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362736:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.362763:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781969.362818:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:2408:x1874624943015808:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 212us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.362826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00010000:00010000:3.0:1787781969.363544:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363554:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363578:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363585:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363592:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363796:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.363801:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363810:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363824:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.363827:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781969.363831:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363838:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363866:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363872:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363878:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363883:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781969.363886:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363891:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363899:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7800) 00010000:00010000:3.0:1787781969.363902:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787781969.363905:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.363910:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063993 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.366534:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11336:x1874624943015424:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 51539us (51716us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787781969.366551:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 93 00000020:00080000:3.0:1787781969.366568:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781969.369208:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781969.369219:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781969.369242:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787781969.369252:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781969.379707:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781969.380139:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943016064 00000100:00100000:3.0:1787781969.380151:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943016064 00000100:00100000:3.0:1787781969.380226:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:3.0:1787781969.380237:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11336:x1874624943016064:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787781969.380561:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787781969.380597:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787781969.380661:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380682:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380695:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380703:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380709:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380715:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.380742:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781969.380849:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11336:x1874624943016064:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 612us (1153us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787781969.380858:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000020:00080000:3.0:1787781969.380864:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787781969.383287:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781969.383306:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.383319:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781969.383324:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.383336:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.383358:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:0.0:1787781969.383361:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787781969.383367:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.383374:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c150639a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.383392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781969.383394:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781969.383395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781969.418334:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963023104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787781969.418437:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781969.418582:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023104 00000100:00100000:3.0:1787781969.419058:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023104 00000100:00100000:3.0:1787781969.419124:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787781969.419135:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963023104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781969.419181:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781969.419243:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963023104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.419251:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787781969.419375:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963023104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787781969.989806:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781971.017076:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787781971.354424:0:14272:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781971.354436:0:14272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781971.354472:0:14272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787781971.354478:0:14272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781971.462839:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963023232:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.462855:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963023488:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.463063:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963023360:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.463877:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781971.463947:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963023744:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.463980:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781971.464012:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963024256:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781971.464082:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963024768:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464106:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781971.464195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023232 00000100:00100000:2.0:1787781971.464204:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023232 00000100:00100000:2.0:1787781971.464276:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787781971.464286:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963023232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963023232:12345-0@lo:400:kworker.0 Request processed in 213us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.464507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787781971.464549:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024256 00000100:00100000:2.0:1787781971.464553:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024256 00000100:00100000:2.0:1787781971.464593:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024768 00000100:00100000:2.0:1787781971.464595:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024768 00000100:00100000:2.0:1787781971.464646:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787781971.464654:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464687:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963024256:12345-0@lo:400:kworker.0 Request processed in 35us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.464694:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787781971.464707:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787781971.464714:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464742:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963024768:12345-0@lo:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.464748:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1787781971.464768:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781971.464773:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781971.464810:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963024768:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464821:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963023232:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464832:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963024256:0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.464851:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781971.464860:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d799b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963024896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781971.464901:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781971.465598:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023744 00000100:00100000:1.0:1787781971.465640:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023744 00000100:00100000:1.0:1787781971.465686:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024896 00000100:00100000:1.0:1787781971.465690:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024896 00000100:00100000:2.0:1787781971.465705:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787781971.465723:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781971.465785:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963023744:12345-0@lo:400:kworker.0 Request processed in 66us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.466125:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787781971.466216:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466257:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963024000:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466294:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466315:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963024512:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466340:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466365:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787781971.466372:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963023616:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466397:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466416:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963024128:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466440:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466456:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963024640:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781971.466527:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466529:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024000 00000100:00100000:0.0:1787781971.466534:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024000 00000100:00100000:3.0:1787781971.466560:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963023872:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.466588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466597:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024512 00000100:00100000:0.0:1787781971.466602:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024512 00000100:00100000:3.0:1787781971.466632:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963024384:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.466643:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023616 00000100:00100000:0.0:1787781971.466647:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023616 00000100:00100000:3.0:1787781971.466663:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781971.466687:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023360 00000100:00100000:0.0:1787781971.466691:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023360 00000100:00100000:3.0:1787781971.466696:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023488 00000100:00100000:3.0:1787781971.466702:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023488 00000100:00100000:0.0:1787781971.466707:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963023872 00000100:00100000:0.0:1787781971.466712:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963023872 00000100:00100000:0.0:1787781971.466730:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024384 00000100:00100000:0.0:1787781971.466732:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024384 00000100:00100000:0.0:1787781971.467759:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787781971.467777:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.469396:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963024000:12345-0@lo:400:kworker.0 Request processed in 1616us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.469410:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787781971.469465:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787781971.469477:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.470883:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963024512:12345-0@lo:400:kworker.0 Request processed in 1400us (4531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.470897:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787781971.470937:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787781971.470949:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.470981:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963023616:12345-0@lo:400:kworker.0 Request processed in 37us (4582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.470987:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787781971.470998:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787781971.471004:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963023360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.471060:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963023360:12345-0@lo:400:kworker.0 Request processed in 55us (4535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.471066:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787781971.471077:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787781971.471084:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.471112:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963023872:12345-0@lo:400:kworker.0 Request processed in 29us (4523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.471117:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787781971.471129:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787781971.471149:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963024384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.471176:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963024384:12345-0@lo:400:kworker.0 Request processed in 42us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.471182:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787781971.475428:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024128 00000100:00100000:0.0:1787781971.475439:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024128 00000100:00100000:0.0:1787781971.475517:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963024640 00000100:00100000:0.0:1787781971.475521:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963024640 00000100:00100000:0.0:1787781971.475565:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787781971.475576:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963024128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.476843:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963024128:12345-0@lo:400:kworker.0 Request processed in 1261us (10392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.476857:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787781971.476889:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787781971.476900:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.476932:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963024640:12345-0@lo:400:kworker.0 Request processed in 36us (10455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.476937:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787781971.477111:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963023616:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.477124:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963024128:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.480324:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963024640:0@lo:400:kworker.0 00010000:00080000:0.0:1787781971.480402:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa0de00 x1874624963024000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781971.480419:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963024000:0@lo:400:kworker.0 00010000:00080000:0.0:1787781971.480431:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa0d680 x1874624963024512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781971.480439:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963024512:0@lo:400:kworker.0 00000100:00100000:1.0:1787781971.481673:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787781971.481704:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963024896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781971.481753:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787781971.481843:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963024896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (16942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.481851:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787781971.486659:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781971.486673:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781971.486678:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781971.486683:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781971.486795:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d799b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963024896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781971.486815:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963023744:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.491238:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787781971.491264:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963023488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.491413:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963023488:12345-0@lo:400:kworker.0 Request processed in 160us (25197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781971.491421:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787781971.503643:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963023488:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.505674:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963023360:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.505702:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963023872:0@lo:400:kworker.0 00000100:00100000:3.0:1787781971.505718:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963024384:0@lo:400:kworker.0 00000100:00100000:0.0:1787781971.555155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781971.564097:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943016320 00000100:00100000:3.0:1787781971.564118:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943016320 00000100:00100000:2.0:1787781971.564489:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 94 00000100:00100000:2.0:1787781971.564503:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:11355:x1874624943016320:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781971.564531:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.564557:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c150639af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a88 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.564742:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150639b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.564759:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150639b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.564771:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150639b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.564793:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787781971.565127:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c150639af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a88 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.565220:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150639b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a88 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.565231:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781971.565234:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787781971.565238:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5200, rc 0) 00000100:00080000:3.0:1787781971.565490:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781971.565774:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:11355:x1874624943016320:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1273us (10631us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787781971.565783:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 94 00000100:00100000:3.0:1787781971.569704:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.569807:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943016448 00000100:00100000:2.0:1787781971.569822:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943016448 00000100:00100000:2.0:1787781971.569901:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 95 00000100:00100000:2.0:1787781971.569914:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:11355:x1874624943016448:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:2.0:1787781971.570104:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570125:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570139:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570157:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570164:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570170:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570280:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570290:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570296:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781971.570351:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570375:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570380:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570388:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570394:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.570398:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570406:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570420:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781971.570423:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.570428:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570434:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150639c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570446:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570452:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570457:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570468:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.570471:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570477:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570486:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c436a7500) 00010000:00010000:2.0:1787781971.570489:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.570491:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570497:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150639cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570514:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570520:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570525:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570530:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.570532:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570538:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.570571:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c436a7200) 00010000:00010000:2.0:1787781971.570574:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.570577:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.573172:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.573560:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:11355:x1874624943016448:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 3634us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.573573:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 95 00000100:00100000:2.0:1787781971.647413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.650085:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943016704 00000100:00100000:1.0:1787781971.650103:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943016704 00000100:00100000:1.0:1787781971.650195:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 96 00000100:00100000:1.0:1787781971.650207:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:11358:x1874624943016704:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781971.650233:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.650260:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150639d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a8f expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650825:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650857:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650869:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650884:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650890:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.650896:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651021:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651028:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651047:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781971.651058:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787781971.651213:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651222:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651228:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651242:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781971.651260:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651268:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651283:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787781971.651286:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.651291:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651298:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150639e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651376:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651383:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651388:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651392:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbe00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781971.651395:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651400:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651417:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c42528f00) 00010000:00010000:1.0:1787781971.651419:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.651422:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651427:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c150639e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651473:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150639d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 23 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651486:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 22 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.651493:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787781971.651495:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781971.651497:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb600, rc 0) 00000100:00100000:1.0:1787781971.651944:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11358:x1874624943016704:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1738us (4543us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787781971.651953:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 96 00000100:00100000:1.0:1787781971.669855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.670046:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943016832 00000100:00100000:2.0:1787781971.670057:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943016832 00000100:00100000:2.0:1787781971.670127:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 97 00000100:00100000:2.0:1787781971.670139:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11358:x1874624943016832:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:2.0:1787781971.670221:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670242:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670255:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670298:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670315:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670334:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670341:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.670346:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670355:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670369:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:2.0:1787781971.670373:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781971.670378:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.670385:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150639fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.670463:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11358:x1874624943016832:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 325us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.670470:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 97 00000100:00100000:2.0:1787781971.697807:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.707277:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017088 00000100:00100000:1.0:1787781971.707292:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017088 00000100:00100000:1.0:1787781971.707369:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:1.0:1787781971.707379:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11358:x1874624943017088:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787781971.707597:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:11358:x1874624943017088:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 219us (9801us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787781971.709167:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:2.0:1787781971.756588:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781971.756746:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017344 00000100:00100000:0.0:1787781971.756759:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017344 00000100:00100000:0.0:1787781971.756824:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 98 00000100:00100000:0.0:1787781971.756835:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:10876:x1874624943017344:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781971.756869:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781971.756906:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a96 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.757066:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.757086:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 24 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.757097:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.757163:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 24 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.757179:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 24 pid: 10060 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781971.757195:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963025024:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781971.757592:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787781971.767066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.767142:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017472 00000100:00100000:1.0:1787781971.767155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017472 00010000:00010000:1.0:1787781971.767216:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 25 pid: 10060 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781971.767329:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963025024:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781971.767358:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.768595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:1.0:1787781971.768638:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:2408:x1874624943017472:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781971.768661:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781971.768673:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 25 pid: 10060 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768690:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 25 pid: 10060 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768717:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c150639ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a8f expref: 25 pid: 10060 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768736:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787781971.768743:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768754:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768762:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.768807:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781971.768888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:2408:x1874624943017472:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 280us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.768896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00010000:00010000:0.0:1787781971.768985:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.768994:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781971.769016:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787781971.769193:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.769213:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.769222:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:0.0:1787781971.769225:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787781971.769237:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:0.0:1787781971.769272:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:10876:x1874624943017344:12345-192.168.206.16@tcp:101:bash.0 Request processed in 12438us (12700us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787781971.769281:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 98 00000100:00100000:3.0:1787781971.783385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.785780:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017600 00000100:00100000:2.0:1787781971.785801:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017600 00000100:00100000:2.0:1787781971.785888:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 99 00000100:00100000:2.0:1787781971.785902:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:10876:x1874624943017600:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781971.785934:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.785960:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063a18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83a9d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786742:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063a1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786762:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063a1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786775:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063a1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786909:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063a18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a9d expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786930:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063a1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a9d expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.786940:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:2.0:1787781971.786943:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781971.786947:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4400, rc 0) 00000100:00100000:2.0:1787781971.787653:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:10876:x1874624943017600:12345-192.168.206.16@tcp:101:bash.0 Request processed in 1748us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.787665:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 99 00000100:00100000:3.0:1787781971.804452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.806730:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017856 00000100:00100000:1.0:1787781971.806748:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017856 00000100:00100000:0.0:1787781971.809734:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 100 00000100:00100000:0.0:1787781971.809755:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:10876:x1874624943017856:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:0.0:1787781971.810411:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.810433:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.810447:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781971.810501:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787781971.810531:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000228e82c reply state 0000000032fcc83c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.810546:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.810553:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:0.0:1787781971.810557:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781971.810560:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787781971.811245:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787781971.811842:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:10876:x1874624943017856:12345-192.168.206.16@tcp:36:bash.0 Request processed in 2086us (7396us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787781971.811854:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 100 00000020:00080000:0.0:1787781971.811861:0:10060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787781971.817415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.817577:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943017984 00000100:00100000:1.0:1787781971.817600:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943017984 00000100:00100000:1.0:1787781971.817796:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 101 00000100:00100000:1.0:1787781971.817808:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:10876:x1874624943017984:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781971.817839:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.817865:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063a2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83aa4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.817937:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063a2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aa4 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.817952:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063a2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aa4 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.817972:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787781971.817975:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781971.817979:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb600, rc 0) 00000100:00100000:1.0:1787781971.818129:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:10876:x1874624943017984:12345-192.168.206.16@tcp:101:bash.0 Request processed in 323us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.818138:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 101 00000100:00100000:3.0:1787781971.821499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.822108:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943018112 00000100:00100000:2.0:1787781971.822121:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943018112 00000100:00100000:2.0:1787781971.822323:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:2.0:1787781971.822337:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:10876:x1874624943018112:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781971.822360:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.822387:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83aab expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781971.822436:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f634f, atime: 0x6a8f634e, ctime: 0x6a8f634f, blocks: 0x8 00010000:00010000:2.0:1787781971.822466:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1787781971.822472:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781971.822482:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.822504:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.822519:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781971.822600:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:10876:x1874624943018112:12345-192.168.206.16@tcp:101:bash.0 Request processed in 268us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.822650:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00080000:3.0:1787781971.822820:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781971.825770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.825893:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943018240 00000100:00100000:1.0:1787781971.825924:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943018240 00002000:00010000:1.0:1787781971.825976:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787781971.825981:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa77c00 with x1874624943018240 ext(0->18446744073709551615) 00002000:00010000:1.0:1787781971.825997:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa77c00. 00000100:00100000:1.0:1787781971.826124:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:1.0:1787781971.826136:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943018240:12345-192.168.206.16@tcp:10:bash.0 00002000:00010000:1.0:1787781971.826913:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787781971.826918:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787781967 -> 1787781971 00002000:00010000:1.0:1787781971.826922:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787781966 -> 1787781966 00002000:00010000:1.0:1787781971.826924:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787781967 -> 1787781971 00002000:00010000:1.0:1787781971.826926:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787781971.827010:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943018240:12345-192.168.206.16@tcp:10:bash.0 Request processed in 872us (1248us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787781971.828238:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00002000:00010000:1.0:1787781971.828246:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787781971.828249:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa77c00 with x1874624943018240 ext(0->18446744073709551615) 00002000:00010000:1.0:1787781971.828261:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa77c00. 00000100:00100000:1.0:1787781971.895856:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.895977:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943018368 00000100:00100000:2.0:1787781971.895990:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943018368 00000100:00100000:2.0:1787781971.896109:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 102 00000100:00100000:2.0:1787781971.896121:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11372:x1874624943018368:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:2.0:1787781971.896223:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896244:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896258:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896298:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896319:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896328:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896421:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896431:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896438:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781971.896495:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896509:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896515:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896522:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896528:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.896533:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896548:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896561:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781971.896564:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.896570:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896577:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896659:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896666:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896673:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896678:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.896681:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896687:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896695:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c436a7f00) 00010000:00010000:2.0:1787781971.896698:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.896702:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896719:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896740:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896760:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896767:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896773:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781971.896776:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896781:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896789:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:2.0:1787781971.896791:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.896794:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.896800:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063a49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.896897:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11372:x1874624943018368:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 776us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.896906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 102 00000100:00100000:2.0:1787781971.949576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781971.949708:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943018624 00000100:00100000:3.0:1787781971.949722:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943018624 00000100:00100000:3.0:1787781971.949866:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 103 00000100:00100000:3.0:1787781971.949880:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11375:x1874624943018624:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781971.949909:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781971.949935:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ab2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950049:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950068:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950083:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950100:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950124:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950132:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950268:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063a65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950278:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950286:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781971.950297:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787781971.950393:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950401:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950408:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950415:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781971.950420:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950428:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950451:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781971.950455:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781971.950460:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950467:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063a57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950481:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950487:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950494:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950498:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781971.950501:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950506:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950513:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:3.0:1787781971.950515:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781971.950518:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950524:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063a5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950577:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab2 expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950592:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab2 expref: 32 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.950599:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:3.0:1787781971.950601:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787781971.950677:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705e00, rc 0) 00000100:00100000:3.0:1787781971.950762:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11375:x1874624943018624:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 886us (1200us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787781971.950769:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 103 00000100:00100000:1.0:1787781971.965991:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781971.966149:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943018752 00000100:00100000:0.0:1787781971.966161:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943018752 00000100:00100000:0.0:1787781971.966236:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 104 00000100:00100000:0.0:1787781971.966249:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11375:x1874624943018752:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:0.0:1787781971.966335:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.966356:0:10060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.966368:0:10060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.966412:0:10060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.966429:0:10060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 32 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781971.966446:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963025152:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781971.966822:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781971.974066:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963025280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781971.974156:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781971.974210:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781971.974218:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963025408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781971.974244:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781971.974281:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963025280 00000100:00100000:1.0:1787781971.974290:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963025280 00000100:00100000:1.0:1787781971.974354:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963025408 00000100:00100000:1.0:1787781971.974357:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963025408 00000100:00100000:1.0:1787781971.974377:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787781971.974387:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963025280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787781971.974423:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781971.974476:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963025280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.974485:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787781971.974504:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787781971.974511:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963025408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781971.974521:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781971.974547:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963025408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.974554:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787781971.975025:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963025408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781971.975061:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963025280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787781971.976328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781971.976429:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963025152:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781971.976459:0:10060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781971.976533:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943019008 00000100:00100000:3.0:1787781971.976546:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943019008 00000100:00100000:3.0:1787781971.976820:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:3.0:1787781971.976832:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:6189:x1874624943019008:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787781971.977238:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:6189:x1874624943019008:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 407us (915us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787781971.977248:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:2.0:1787781971.989091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781971.989219:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943019136 00000100:00100000:1.0:1787781971.989233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943019136 00010000:00010000:1.0:1787781971.989285:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 34 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.989338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:1.0:1787781971.989350:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:2408:x1874624943019136:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781971.989379:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781971.989388:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 34 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989425:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 34 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989454:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063a0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a96 expref: 34 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989477:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787781971.989483:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989494:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989503:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.989544:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781971.989681:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:2408:x1874624943019136:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 332us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.989690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 66 00010000:00010000:0.0:1787781971.990113:0:10060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990124:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990174:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990730:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990739:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990746:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781971.990750:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990758:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990774:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:0.0:1787781971.990777:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781971.990781:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.990788:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063a73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781971.990872:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11375:x1874624943018752:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 24622us (24890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.990882:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 104 00000001:00080000:3.0:1787781971.992966:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787781971.992991:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1787781971.995172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781971.995756:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943019392 00000100:00100000:3.0:1787781971.995769:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943019392 00000100:00100000:3.0:1787781971.995888:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:3.0:1787781971.995902:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:11375:x1874624943019392:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:3.0:1787781971.996229:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:11375:x1874624943019392:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 329us (1068us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787781971.996237:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00010000:00010000:3.0:1787781972.037930:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781972.101882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.102876:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943019648 00000100:00100000:2.0:1787781972.102892:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943019648 00000100:00100000:2.0:1787781972.102979:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 105 00000100:00100000:2.0:1787781972.102991:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:11386:x1874624943019648:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:2.0:1787781972.103023:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.103164:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103254:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103271:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103285:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103301:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103310:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103316:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103476:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063a8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103487:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.103495:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781972.103507:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787781972.105228:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105249:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105257:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105263:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781972.105269:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105277:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105297:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781972.105301:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781972.105307:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105338:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063a81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105359:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105366:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105372:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105377:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781972.105380:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105385:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105393:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993c436a7800) 00010000:00010000:2.0:1787781972.105396:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781972.105398:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105404:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063a88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105482:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063a7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab9 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105510:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab9 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.105526:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:2.0:1787781972.105528:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781972.105531:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4a00, rc 0) 00000100:00100000:2.0:1787781972.108293:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11386:x1874624943019648:12345-192.168.206.16@tcp:101:cat.0 Request processed in 5284us (6408us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787781972.108312:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 105 00000100:00100000:0.0:1787781972.120907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.121064:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943019904 00000100:00100000:1.0:1787781972.121076:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943019904 00000100:00100000:1.0:1787781972.121148:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787781972.121159:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11386:x1874624943019904:12345-192.168.206.16@tcp:35:cat.0 00000100:00100000:1.0:1787781972.121597:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:11386:x1874624943019904:12345-192.168.206.16@tcp:35:cat.0 Request processed in 438us (701us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787781972.121692:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787781972.162325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.162480:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943020160 00000100:00100000:2.0:1787781972.162493:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943020160 00000100:00100000:2.0:1787781972.162572:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 106 00000100:00100000:2.0:1787781972.162595:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:11387:x1874624943020160:12345-192.168.206.16@tcp:36:rm.0 00010000:00010000:2.0:1787781972.162950:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787781972.162988:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063a2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aa4 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.163013:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063a8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab9 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.163308:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063a65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ab2 expref: 34 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.163331:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063a1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a9d expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.163343:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:2.0:1787781972.163349:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781972.167407:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167439:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167455:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167483:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167491:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167497:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167702:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167713:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.167721:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787781972.168433:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787781972.168463:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409249854845ns, next at 410249851600ns, rc = 0 00010000:00010000:3.0:1787781972.168543:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168557:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168568:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168576:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168582:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168589:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168648:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787781972.168675:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168683:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168689:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168696:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781972.168701:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168720:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168734:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:3.0:1787781972.168737:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787781972.168743:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168749:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168773:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168779:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168784:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168789:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781972.168792:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168797:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168805:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781972.168807:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.168810:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168825:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063a9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781972.168836:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048d75e23 reply state 00000000bf3768a4 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168861:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.168868:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:3.0:1787781972.168871:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781972.168874:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781972.169002:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:11387:x1874624943020160:12345-192.168.206.16@tcp:36:rm.0 Request processed in 6413us (6684us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787781972.169012:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 106 00010000:00010000:0.0:1787781972.169225:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781972.169234:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.169251:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781972.169255:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.169260:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.169269:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:0.0:1787781972.169272:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787781972.169275:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.169279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ab2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.169290:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781972.169292:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781972.169294:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781972.242847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.243220:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943020416 00000100:00100000:3.0:1787781972.243232:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943020416 00000100:00100000:3.0:1787781972.243340:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 107 00000100:00100000:3.0:1787781972.243370:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:11393:x1874624943020416:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781972.243419:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.243453:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063ab9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ac0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243736:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243766:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243810:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243837:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243846:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.243853:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781972.244497:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787781972.244702:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.244977:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245004:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245152:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245160:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245168:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245175:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781972.245194:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245202:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245217:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781972.245220:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.245225:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245233:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063ac0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781972.245249:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081f716e0 reply state 00000000a0129eaa transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245261:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245268:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:3.0:1787781972.245270:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781972.245273:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787781972.245325:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063ab9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245359:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.245367:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:3.0:1787781972.245370:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781972.245378:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705e00, rc 0) 00000100:00100000:3.0:1787781972.246005:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:11393:x1874624943020416:12345-192.168.206.16@tcp:101:bash.0 Request processed in 2651us (3190us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787781972.246059:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 107 00000100:00100000:1.0:1787781972.255732:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.255918:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943020544 00000100:00100000:0.0:1787781972.255930:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943020544 00000100:00100000:0.0:1787781972.256011:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:0.0:1787781972.256023:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943020544:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781972.256054:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.256086:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ac7 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781972.256117:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787781972.256142:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787781972.256147:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781972.256174:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.256199:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.256214:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:0.0:1787781972.256289:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943020544:12345-192.168.206.16@tcp:101:bash.0 Request processed in 269us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.256297:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00080000:3.0:1787781972.256812:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781972.263963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.264677:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943020672 00000100:00100000:2.0:1787781972.264690:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943020672 00000100:00100000:2.0:1787781972.264770:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:2.0:1787781972.264783:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:11393:x1874624943020672:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781972.264804:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.264825:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ace expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.264864:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.264876:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.264881:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.264886:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.264927:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.264943:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.264960:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963025536:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781972.265480:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.270408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.270547:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963025536:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781972.270647:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.270673:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4400, rc 0) 00000100:00100000:2.0:1787781972.270736:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11393:x1874624943020672:12345-192.168.206.16@tcp:101:bash.0 Request processed in 5955us (6787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.270747:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:3.0:1787781972.270778:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943020800 00000100:00100000:3.0:1787781972.270787:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943020800 00010000:00010000:3.0:1787781972.270829:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.270883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:3.0:1787781972.270894:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943020800:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781972.270912:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781972.270936:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.270950:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.270979:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000473f494a/0xc6d6745c15063adc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac7 expref: 7 pid: 8446 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.270996:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781972.271001:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781972.271009:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.271046:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.271088:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.271104:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6517:1874624963025664:192.168.206.16@tcp:105: 00000100:00100000:3.0:1787781972.271182:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.281488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.281633:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021056 00000100:00100000:0.0:1787781972.281646:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021056 00000100:00100000:3.0:1787781972.281701:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa76d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6517:1874624963025664:192.168.206.16@tcp:105: 00010000:00010000:3.0:1787781972.281736:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781972.281745:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:0.0:1787781972.281758:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:11393:x1874624943021056:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:3.0:1787781972.281805:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943020800:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 10913us (11410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.281817:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:0.0:1787781972.282324:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11393:x1874624943021056:12345-192.168.206.16@tcp:35:bash.0 Request processed in 567us (847us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787781972.282345:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:1.0:1787781972.367854:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.367904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.367937:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.367973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.367989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.368011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.368117:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021440 00000100:00100000:2.0:1787781972.368131:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021440 00000100:00100000:2.0:1787781972.368194:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021568 00000100:00100000:2.0:1787781972.368198:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021568 00000100:00100000:2.0:1787781972.368227:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:2.0:1787781972.368239:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943021440:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781972.368321:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943021440:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 84us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.368329:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:2.0:1787781972.368349:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:2.0:1787781972.368356:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943021568:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781972.368382:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943021568:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.368388:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:2.0:1787781972.368410:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021696 00000100:00100000:2.0:1787781972.368414:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021696 00000100:00100000:2.0:1787781972.368451:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021312 00000100:00100000:2.0:1787781972.368454:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021312 00000100:00100000:2.0:1787781972.368467:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021824 00000100:00100000:2.0:1787781972.368483:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021824 00000100:00100000:2.0:1787781972.368500:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 297 00000100:00100000:2.0:1787781972.368506:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943021696:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781972.368533:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943021696:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.368539:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 297 00000100:00100000:2.0:1787781972.368550:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 298 00000100:00100000:2.0:1787781972.368556:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943021312:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781972.368574:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943021312:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 19us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.368580:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 298 00000100:00100000:2.0:1787781972.368589:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 299 00000100:00100000:2.0:1787781972.368594:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943021824:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781972.368649:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943021824:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 54us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.368655:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 299 00000100:00080000:2.0:1787781972.368684:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781972.368688:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781972.369714:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021184 00000100:00100000:0.0:1787781972.369724:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021184 00000100:00100000:0.0:1787781972.369779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 381 00000100:00100000:0.0:1787781972.369788:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943021184:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781972.369852:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943021184:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 65us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.369859:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 381 00000100:00100000:1.0:1787781972.467908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.470405:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943021952 00000100:00100000:2.0:1787781972.470428:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943021952 00000100:00100000:2.0:1787781972.470525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 108 00000100:00100000:2.0:1787781972.470539:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:11409:x1874624943021952:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781972.470571:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.470598:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ad5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470733:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470750:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470764:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781972.470817:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787781972.470822:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781972.470844:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470871:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ad5 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470894:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ad5 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.470904:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781972.470907:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781972.470911:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5400, rc 0) 00000100:00100000:2.0:1787781972.470997:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:11409:x1874624943021952:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 460us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.471005:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 108 00000100:00100000:1.0:1787781972.477233:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.479803:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022208 00000100:00100000:3.0:1787781972.479825:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022208 00000100:00100000:3.0:1787781972.479929:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 109 00000100:00100000:3.0:1787781972.479942:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:11409:x1874624943022208:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781972.479970:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.479996:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063af8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83adc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.480147:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.480166:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.480197:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781972.480211:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787781972.480343:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063af8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83adc expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.480366:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83adc expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.480377:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:3.0:1787781972.480380:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781972.480384:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705800, rc 0) 00000100:00100000:3.0:1787781972.480476:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+41:11409:x1874624943022208:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 537us (3255us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787781972.480485:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 109 00000100:00100000:2.0:1787781972.486145:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787781972.486174:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963025792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781972.486261:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.486262:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781972.486317:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963025792 00000100:00100000:1.0:1787781972.486322:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.486328:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963025792 00000100:00100000:2.0:1787781972.486333:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963025920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781972.486366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781972.486382:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022464 00000100:00100000:1.0:1787781972.486388:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022464 00000100:00100000:3.0:1787781972.486398:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963025920 00000100:00100000:3.0:1787781972.486403:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963025920 00000100:00100000:2.0:1787781972.486422:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787781972.486435:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963025792:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781972.486459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022592 00002000:00000024:2.0:1787781972.486471:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781972.486472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022592 00000100:00100000:0.0:1787781972.486518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:2.0:1787781972.486528:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963025792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.486542:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:2409:x1874624943022592:12345-192.168.206.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787781972.486563:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 110 00000100:00100000:3.0:1787781972.486568:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787781972.486576:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:11409:x1874624943022464:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781972.486597:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781972.486646:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063b0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ae3 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.486767:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963025920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781972.486780:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00010000:00010000:0.0:1787781972.486805:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.486830:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c15063aff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83adc expref: 43 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.486848:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:0.0:1787781972.486853:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781972.486896:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963025920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.486902:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:2409:x1874624943022592:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 361us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.486910:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787781972.486915:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:3.0:1787781972.486984:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963025792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781972.487012:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963025920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781972.488339:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:1.0:1787781972.491312:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.491341:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.491376:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781972.491392:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787781972.491555:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063b0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ae3 expref: 43 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.491579:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ae3 expref: 42 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.491588:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:1.0:1787781972.491591:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781972.491595:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfae00, rc 0) 00000100:00100000:1.0:1787781972.491865:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:11409:x1874624943022464:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 5289us (5608us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787781972.491875:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 110 00000100:00100000:1.0:1787781972.508205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.508331:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022720 00000100:00100000:2.0:1787781972.508344:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022720 00000100:00100000:2.0:1787781972.508466:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:2.0:1787781972.508478:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943022720:12345-192.168.206.16@tcp:1:lfs.0 00010000:00010000:2.0:1787781972.508550:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.508577:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.508587:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.508592:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781972.508598:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.508686:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.508723:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 6 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.508741:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963026048:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781972.508855:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781972.515865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.515941:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022848 00000100:00100000:3.0:1787781972.515953:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022848 00002000:00100000:3.0:1787781972.516017:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff993d7fa0e940 x1874624943022848/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:118/0 lens 504/0 e 0 to 0 dl 1787781983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781972.516043:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa0e940 with x1874624943022848 ext(0->8) 00010000:00010000:3.0:1787781972.516054:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 7 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.516074:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 7 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781972.516084:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d7fa0e940 00000100:00100000:3.0:1787781972.516125:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:3.0:1787781972.516136:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943022848:12345-192.168.206.16@tcp:4:lfs.0 00000100:00100000:0.0:1787781972.517000:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1874624963026048:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781972.517047:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.517296:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943022848:12345-192.168.206.16@tcp:4:lfs.0 Request processed in 1160us (1442us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787781972.517312:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00002000:00100000:2.0:1787781972.517323:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff993d7fa0e940 x1874624943022848/t4294967303(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:118/0 lens 504/448 e 0 to 0 dl 1787781983 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781972.517332:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa0e940 with x1874624943022848 ext(0->8) 00010000:00010000:2.0:1787781972.517340:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.517354:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781972.517362:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d7fa0e940 00000100:00100000:0.0:1787781972.522739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.522850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943022976 00000100:00100000:1.0:1787781972.522861:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943022976 00010000:00010000:1.0:1787781972.522912:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.522964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:1.0:1787781972.522976:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943022976:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781972.522993:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787781972.523015:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787781972.523042:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787781971 00002000:00010000:1.0:1787781972.523045:0:6516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787781972 00002000:00010000:1.0:1787781972.523047:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787781971 00002000:00010000:1.0:1787781972.523050:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787781972.523059:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.523075:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.523107:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eacd760/0xc6d6745c15063ae3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ace expref: 9 pid: 8445 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.523130:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781972.523134:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781972.523142:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.523153:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.523188:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781972.523259:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943022976:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 284us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.523268:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 68 00010000:00010000:0.0:1787781972.523440:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523450:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523472:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523496:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523506:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523515:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781972.523532:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523546:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523561:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.523569:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c15063b22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.523695:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943022720:12345-192.168.206.16@tcp:1:lfs.0 Request processed in 15217us (15504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.523704:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:1.0:1787781972.529265:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.529366:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943023232 00000100:00100000:0.0:1787781972.529379:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943023232 00000100:00100000:0.0:1787781972.529452:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:0.0:1787781972.529482:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:11409:x1874624943023232:12345-192.168.206.16@tcp:35:lfs.0 00000004:00010000:0.0:1787781972.529577:0:6534:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ae3 expref: 42 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781972.529858:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787781972.529889:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787781972.530290:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787781972.530336:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.530354:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.530365:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.530407:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.530426:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 46 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.530442:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874624963026176:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781972.530541:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781972.533505:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874624963026176:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781972.533736:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.534007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.534479:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943023360 00000100:00100000:0.0:1787781972.534489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943023360 00010000:00010000:0.0:1787781972.534863:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 47 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.534962:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:0.0:1787781972.534975:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:2409:x1874624943023360:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781972.534992:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.535000:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 47 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535014:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 47 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535054:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15063ace lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ac0 expref: 47 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535073:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:0.0:1787781972.535078:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535088:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535097:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.535132:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781972.535231:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+46:2409:x1874624943023360:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 258us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.535238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 69 00010000:00010000:1.0:1787781972.537545:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.537564:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781972.537752:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787781972.537888:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787781972.538001:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963026304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787781972.538092:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781972.538134:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781972.538962:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963026304 00000100:00100000:3.0:1787781972.538974:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963026304 00000100:00100000:3.0:1787781972.539067:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787781972.539077:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963026304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787781972.539207:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963026304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.539215:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787781972.539569:0:6534:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1787781972.539576:0:6534:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1787781972.539626:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43e43840, transno 4294967302 00000100:00100000:1.0:1787781972.539650:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963026304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787781972.539807:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787781972.539882:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963026432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787781972.539925:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781972.539948:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781972.540209:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963026432 00000100:00100000:3.0:1787781972.540215:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963026432 00000100:00100000:3.0:1787781972.540265:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787781972.540274:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1874624963026432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787781972.540434:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ca9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6534:x1874624963026432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 161us (508us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787781972.540442:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787781972.542150:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874624963026432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787781972.542262:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787781972.542329:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542341:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542349:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542374:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781972.542379:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542388:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542407:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:1.0:1787781972.542410:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787781972.542415:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.542421:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b29 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781972.543360:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787781972.543447:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787781972.543462:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409624853904ns, next at 410624850787ns, rc = 0 00000001:00080000:1.0:1787781972.543472:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787781972.543518:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097000) 00010000:00010000:1.0:1787781972.543522:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781972.543877:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063b14 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ae3 expref: 50 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.544025:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:11409:x1874624943023232:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 14546us (14773us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787781972.544049:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000020:00080000:1.0:1787781972.544056:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787781972.549940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.550694:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943023488 00000100:00100000:3.0:1787781972.550710:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943023488 00000100:00100000:3.0:1787781972.550827:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 111 00000100:00100000:3.0:1787781972.550838:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:11409:x1874624943023488:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781972.550867:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.550896:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063b30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83aea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.550961:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063b30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aea expref: 50 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.550978:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063b30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aea expref: 50 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.550998:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.551001:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781972.551005:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704200, rc 0) 00000100:00100000:3.0:1787781972.551095:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:11409:x1874624943023488:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 258us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.551103:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 111 00000100:00100000:2.0:1787781972.560841:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.562830:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943023744 00000100:00100000:3.0:1787781972.562850:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943023744 00000100:00100000:3.0:1787781972.563012:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:3.0:1787781972.563037:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:11409:x1874624943023744:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:3.0:1787781972.563439:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:11409:x1874624943023744:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 414us (2610us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787781972.563449:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:1.0:1787781972.673944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.674069:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943023872 00000100:00100000:0.0:1787781972.674082:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943023872 00000100:00100000:0.0:1787781972.674156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 112 00000100:00100000:0.0:1787781972.674167:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:11419:x1874624943023872:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:0.0:1787781972.674291:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674312:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674326:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674338:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674346:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674354:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674455:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674465:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674472:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781972.674548:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674578:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674587:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674593:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674600:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.674654:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674663:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674678:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781972.674681:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.674687:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674694:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674711:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674717:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674728:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674733:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.674735:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674741:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674748:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:0.0:1787781972.674750:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.674753:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674758:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674767:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674772:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674777:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674781:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.674783:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674795:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674801:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.674803:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.674805:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.674810:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.674886:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:11419:x1874624943023872:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 721us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.674893:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 112 00000100:00100000:2.0:1787781972.760264:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.760385:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943024128 00000100:00100000:0.0:1787781972.760396:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943024128 00000100:00100000:0.0:1787781972.760518:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 113 00000100:00100000:0.0:1787781972.760531:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:11422:x1874624943024128:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781972.760559:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.760585:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83af1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760705:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760721:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760734:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760765:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760773:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760779:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760915:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063b61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760924:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.760931:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781972.760942:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787781972.761043:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761052:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761059:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761066:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.761070:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761087:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761100:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781972.761103:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.761108:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761113:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063b53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761127:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761132:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761137:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761142:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.761144:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761149:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761155:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:0.0:1787781972.761157:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.761160:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761172:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761211:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af1 expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761226:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af1 expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.761234:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.761236:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781972.761239:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:0.0:1787781972.761318:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11422:x1874624943024128:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 789us (1066us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787781972.761325:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 113 00000100:00100000:2.0:1787781972.764676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.764779:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943024256 00000100:00100000:0.0:1787781972.764791:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943024256 00000100:00100000:0.0:1787781972.764863:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 114 00000100:00100000:0.0:1787781972.764874:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11422:x1874624943024256:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:0.0:1787781972.764962:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.764980:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.764991:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765058:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765065:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765071:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765077:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781972.765081:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765088:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765100:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.765104:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781972.765108:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.765114:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.765200:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11422:x1874624943024256:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 327us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.765209:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 114 00000100:00100000:1.0:1787781972.768107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.768211:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943024512 00000100:00100000:2.0:1787781972.768236:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943024512 00000100:00100000:2.0:1787781972.768298:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:2.0:1787781972.768308:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:11422:x1874624943024512:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781972.768584:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11422:x1874624943024512:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 269us (479us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787781972.768594:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:2.0:1787781972.872579:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.872813:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943024768 00000100:00100000:3.0:1787781972.872825:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943024768 00000100:00100000:3.0:1787781972.872895:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 115 00000100:00100000:3.0:1787781972.872906:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:11432:x1874624943024768:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781972.872937:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.872941:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787781972.872974:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063af1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ad5 expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.872997:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781972.873002:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781972.873019:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063b76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83af8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.873163:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.873179:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.873203:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781972.873216:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787781972.873342:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063b76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.873574:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.873583:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.873586:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781972.873589:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705000, rc 0) 00000100:00100000:3.0:1787781972.873857:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:11432:x1874624943024768:12345-192.168.206.16@tcp:101:bash.0 Request processed in 951us (1291us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787781972.873866:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 115 00000100:00100000:1.0:1787781972.876436:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.876986:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943024896 00000100:00100000:0.0:1787781972.877009:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943024896 00000100:00100000:0.0:1787781972.877091:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 116 00000100:00100000:0.0:1787781972.877119:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:11432:x1874624943024896:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781972.877152:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.877177:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83aff expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877219:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877236:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877248:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877380:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063b8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877402:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 56 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.877412:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.877415:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781972.877419:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167200, rc 0) 00000100:00100000:0.0:1787781972.877691:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:11432:x1874624943024896:12345-192.168.206.16@tcp:101:bash.0 Request processed in 578us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.877699:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 116 00000100:00100000:3.0:1787781972.878555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.881369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.881459:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025280 00000100:00100000:0.0:1787781972.881473:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025280 00000100:00100000:0.0:1787781972.881553:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 117 00000100:00100000:0.0:1787781972.881592:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:11432:x1874624943025280:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:0.0:1787781972.881693:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.881727:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063b61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af1 expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.881750:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.881756:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781972.881978:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.882009:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.882019:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.882068:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.882085:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.882101:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963026560:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781972.882215:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.883773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025024 00000100:00100000:1.0:1787781972.883788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025024 00010000:00010000:1.0:1787781972.883846:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 57 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.883935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:1.0:1787781972.883945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:2409:x1874624943025024:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781972.883961:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781972.883968:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 57 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.883982:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 57 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.884018:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781972.884033:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.884044:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.884053:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.884074:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781972.884148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:2409:x1874624943025024:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 204us (5597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.884176:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 70 00010000:00010000:3.0:1787781972.887373:0:6531:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.16@tcp) returned -22 from blocking AST (req@000000006bf9e8d7 x1874624963026560) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.887405:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063b7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83af8 expref: 56 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.887423:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963026560:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781972.887450:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.887459:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.887469:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.887475:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781972.887698:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787781972.887758:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4519e5d reply state 00000000e8402b68 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.887775:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.887783:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.887786:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781972.887789:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781972.887919:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11432:x1874624943025280:12345-192.168.206.16@tcp:36:bash.0 Request processed in 6337us (6563us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787781972.887929:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 117 00000020:00080000:3.0:1787781972.887936:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787781972.890741:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.890844:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025408 00000100:00100000:0.0:1787781972.890858:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025408 00000100:00100000:0.0:1787781972.890927:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 118 00000100:00100000:0.0:1787781972.890938:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:11432:x1874624943025408:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781972.890981:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.891018:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063ba0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b06 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891145:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891162:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891176:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781972.891211:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787781972.891215:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781972.891237:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891270:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063ba0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 59 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891291:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 58 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.891300:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.891304:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781972.891308:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166a00, rc 0) 00000100:00100000:0.0:1787781972.891390:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11432:x1874624943025408:12345-192.168.206.16@tcp:101:bash.0 Request processed in 453us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.891398:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 118 00000100:00100000:0.0:1787781972.894777:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.894910:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025664 00000100:00100000:2.0:1787781972.894922:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025664 00000100:00100000:2.0:1787781972.895101:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:2.0:1787781972.895114:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:11432:x1874624943025664:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:2.0:1787781972.895455:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:11432:x1874624943025664:12345-192.168.206.16@tcp:35:bash.0 Request processed in 340us (1011us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787781972.895465:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:3.0:1787781972.946528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.946669:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025792 00000100:00100000:0.0:1787781972.946683:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025792 00000100:00100000:0.0:1787781972.946756:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 119 00000100:00100000:0.0:1787781972.946768:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:11438:x1874624943025792:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781972.946796:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.946822:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b0d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.946900:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.946917:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.946931:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781972.946987:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787781972.946992:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781972.947015:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.947054:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b0d expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.947077:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b0d expref: 60 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.947086:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781972.947103:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781972.947107:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:0.0:1787781972.947189:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943025792:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 424us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.947198:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 119 00000100:00100000:0.0:1787781972.950988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.951123:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943025920 00000100:00100000:2.0:1787781972.951135:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943025920 00000100:00100000:2.0:1787781972.951199:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 120 00000100:00100000:2.0:1787781972.951209:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943025920:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781972.951233:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.951260:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063bbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b14 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951335:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951353:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951525:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951540:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951548:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951554:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951854:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951865:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951872:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781972.951924:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787781972.951929:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781972.951952:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951966:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951975:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.951994:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952001:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952007:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781972.952012:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952020:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952043:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:2.0:1787781972.952046:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781972.952051:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952058:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15063bc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952074:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952079:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952085:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952090:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781972.952099:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952106:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952115:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:2.0:1787781972.952117:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781972.952120:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952125:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15063bca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952172:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15063bbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b14 expref: 62 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952188:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b14 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.952197:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:2.0:1787781972.952200:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781972.952202:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4c00, rc 0) 00000100:00100000:2.0:1787781972.952332:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11438:x1874624943025920:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1123us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.952341:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 120 00000100:00100000:1.0:1787781972.956559:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.957312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781972.957422:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026048 00000100:00100000:0.0:1787781972.957423:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026304 00000100:00100000:2.0:1787781972.957435:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026048 00000100:00100000:0.0:1787781972.957435:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026304 00000100:00100000:0.0:1787781972.957694:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:0.0:1787781972.957707:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11438:x1874624943026304:12345-192.168.206.16@tcp:101:lfs.0 00000100:00100000:2.0:1787781972.957729:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 8 00010000:00010000:0.0:1787781972.957729:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787781972.957737:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:2406:x1874624943026048:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781972.957754:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063bd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b1b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.957767:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781972.957791:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063bd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b14 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.957811:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:2.0:1787781972.957816:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781972.957880:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:2406:x1874624943026048:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 144us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.957887:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 8 00010000:00010000:0.0:1787781972.957892:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.957905:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.958038:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.958080:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.958095:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 61 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.958124:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963026688:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781972.958876:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.961568:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.961656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026432 00000100:00100000:3.0:1787781972.961667:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026432 00010000:00010000:3.0:1787781972.961715:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 62 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.961762:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 71 00000100:00100000:3.0:1787781972.961772:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:2408:x1874624943026432:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781972.961789:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781972.961796:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 62 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.961810:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 62 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.961859:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.961865:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.961877:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.961885:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.961909:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781972.961984:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:2408:x1874624943026432:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 212us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.961992:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 71 00010000:00010000:0.0:1787781972.962691:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063ba7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b06 expref: 61 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.962713:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963026688:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781972.962741:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.962752:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.962758:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781972.962780:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787781972.962934:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063bd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 62 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.962950:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.962959:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.962963:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787781972.962966:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:0.0:1787781972.963008:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11438:x1874624943026304:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 5304us (5700us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787781972.963044:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:1.0:1787781972.967488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781972.967760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026688 00000100:00100000:0.0:1787781972.967773:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026688 00000100:00100000:0.0:1787781972.967985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787781972.968000:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11438:x1874624943026688:12345-192.168.206.16@tcp:103:lfs.0 00010000:00010000:0.0:1787781972.968020:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.968077:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c15063b30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aea expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.968100:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781972.968106:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781972.968217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943026688:12345-192.168.206.16@tcp:103:lfs.0 Request processed in 221us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.968226:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:2.0:1787781972.970740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781972.970970:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026816 00000100:00100000:1.0:1787781972.970982:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026816 00000100:00100000:1.0:1787781972.971329:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00100000:1.0:1787781972.971342:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943026816:12345-192.168.206.16@tcp:58:lfs.0 00010000:00010000:1.0:1787781972.971519:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.971541:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.971555:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781972.971716:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787781972.971826:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943026816:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 485us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.971834:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00100000:1.0:1787781972.979880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781972.979986:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943026944 00000100:00100000:3.0:1787781972.979999:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943026944 00000100:00100000:3.0:1787781972.980083:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 123 00000100:00100000:3.0:1787781972.980096:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:11438:x1874624943026944:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781972.980122:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.980148:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b22 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980401:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980414:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980471:0:6531:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980488:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980505:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781972.980508:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781972.980513:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.980523:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705000, rc 0) 00000100:00100000:3.0:1787781972.980603:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11438:x1874624943026944:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 510us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.984172:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 123 00010000:00010000:0.0:1787781973.062917:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787781973.446715:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781973.446730:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781973.446795:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787781973.446809:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781973.447536:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963026816:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781973.447833:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787781973.453548:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0eb0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963026816:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781973.453950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.454042:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943027072 00000100:00100000:1.0:1787781973.454052:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943027072 00000100:00100000:1.0:1787781973.454142:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 124 00000100:00100000:1.0:1787781973.454153:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11439:x1874624943027072:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787781973.454212:0:10060:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787781973.454359:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11439:x1874624943027072:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 206us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.454367:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 124 00000100:00080000:2.0:1787781973.454652:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781973.458128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.458246:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943027200 00000100:00100000:0.0:1787781973.458258:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943027200 00000100:00100000:0.0:1787781973.458335:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 125 00000100:00100000:0.0:1787781973.458347:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11439:x1874624943027200:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.458669:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458758:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458774:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458795:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458803:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458810:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458838:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458849:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.458983:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781973.459055:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787781973.459060:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781973.459077:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459090:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459106:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459113:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459119:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781973.459124:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459133:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459148:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:0.0:1787781973.459152:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781973.459157:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459164:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063bfb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459181:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459188:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459195:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459201:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781973.459211:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459217:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459226:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff993d679e1d00) 00010000:00010000:0.0:1787781973.459229:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781973.459231:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459238:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063c02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459255:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459261:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459267:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459272:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781973.459275:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459281:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459289:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781973.459291:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781973.459300:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.459306:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.459559:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11439:x1874624943027200:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 Request processed in 1211us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.459570:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 125 00000100:00100000:3.0:1787781973.466892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.466971:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943027456 00000100:00100000:1.0:1787781973.466984:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943027456 00000100:00100000:1.0:1787781973.467074:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 126 00000100:00100000:1.0:1787781973.467086:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:11439:x1874624943027456:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781973.467112:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781973.467138:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063c10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b29 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467266:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467284:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467297:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781973.467309:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787781973.467411:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467419:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467464:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467471:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781973.467476:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467485:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467499:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781973.467503:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781973.467508:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467516:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467569:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063c10 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b29 expref: 63 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467581:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:1.0:1787781973.467583:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781973.467587:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063c10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b29 expref: 63 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.467596:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787781973.468038:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943027456:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 952us (1157us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787781973.468058:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 126 00000100:00100000:2.0:1787781973.475584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.476502:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943027584 00000100:00100000:3.0:1787781973.476516:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943027584 00000100:00100000:3.0:1787781973.476589:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 127 00000100:00100000:3.0:1787781973.476600:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943027584:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787781973.476682:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787781973.476838:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943027584:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 239us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781973.476847:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 127 00000100:00100000:2.0:1787781973.481226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.482516:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943027840 00000100:00100000:0.0:1787781973.482532:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943027840 00000100:00100000:0.0:1787781973.482657:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 128 00000100:00100000:0.0:1787781973.482670:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943027840:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.482848:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.482862:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787781973.482905:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b0d expref: 62 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.482929:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:0.0:1787781973.482935:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781973.482952:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c25 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b30 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781973.483420:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787781973.483661:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063c2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.483678:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.483712:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.483774:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c25 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b30 expref: 64 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.483790:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063c2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b30 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.483798:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1d00) 00010000:00010000:0.0:1787781973.483801:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781973.483804:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781973.483892:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:11439:x1874624943027840:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 1224us (2679us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787781973.483900:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 128 00000100:00100000:1.0:1787781973.493584:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.493827:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028096 00000100:00100000:3.0:1787781973.493854:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028096 00000100:00100000:3.0:1787781973.493929:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:3.0:1787781973.493940:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:11439:x1874624943028096:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781973.494007:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781973.494052:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063c2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b30 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.494073:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1d00) 00010000:00010000:3.0:1787781973.494085:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781973.494110:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.494126:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.494137:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495076:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495099:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495112:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495160:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495169:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495190:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495195:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.495199:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495207:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495219:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781973.495222:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.495226:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495232:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063c3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495248:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495254:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495260:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495265:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.495268:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495285:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495294:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3a5e9d90 (ffff993d6d097400) 00010000:00010000:3.0:1787781973.495297:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.495300:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.495307:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3a5e9d90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.495410:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943028096:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 1468us (1836us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787781973.495420:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:3.0:1787781973.498901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.499015:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028224 00000100:00100000:0.0:1787781973.499046:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028224 00000100:00100000:0.0:1787781973.499138:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00100000:0.0:1787781973.499150:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:11439:x1874624943028224:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.499174:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.499211:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b37 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499253:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499269:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499308:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499453:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 64 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499478:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.499488:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781973.499492:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781973.499496:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9a00, rc 0) 00000100:00100000:0.0:1787781973.499603:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:11439:x1874624943028224:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 454us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.499659:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00100000:2.0:1787781973.505019:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.505097:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028480 00000100:00100000:0.0:1787781973.505113:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028480 00000100:00100000:0.0:1787781973.505195:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 131 00000100:00100000:0.0:1787781973.505206:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:11439:x1874624943028480:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.505333:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.505357:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.505372:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781973.505604:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787781973.505664:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410587056251ns, next at 411587053043ns, rc = 0 00000004:00010000:0.0:1787781973.505728:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018579b62 reply state 0000000059f387ae transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.505742:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.505751:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781973.505754:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787781973.505758:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781973.505889:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:11439:x1874624943028480:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 683us (879us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787781973.505897:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 131 00000100:00100000:3.0:1787781973.508009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.508078:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028608 00000100:00100000:0.0:1787781973.508090:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028608 00000100:00100000:0.0:1787781973.508158:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 132 00000100:00100000:0.0:1787781973.508170:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:11439:x1874624943028608:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.508197:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.508220:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b3e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.508286:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.508421:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.508469:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781973.508473:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781973.508477:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9e00, rc 0) 00000100:00100000:0.0:1787781973.508551:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:11439:x1874624943028608:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 383us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.508558:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 132 00000100:00100000:3.0:1787781973.513756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781973.514113:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028736 00000100:00100000:2.0:1787781973.514126:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028736 00000100:00100000:2.0:1787781973.514231:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:2.0:1787781973.514243:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943028736:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787781973.514510:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943028736:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 268us (767us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787781973.514520:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00080000:3.0:1787781973.515154:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781973.520993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.522626:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943028992 00000100:00100000:3.0:1787781973.522643:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943028992 00000100:00100000:2.0:1787781973.522892:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:2.0:1787781973.522905:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:11439:x1874624943028992:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781973.523229:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:11439:x1874624943028992:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 325us (2250us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787781973.523238:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:0.0:1787781973.525323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.525455:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943029248 00000100:00100000:3.0:1787781973.525467:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943029248 00000100:00100000:3.0:1787781973.525532:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 133 00000100:00100000:3.0:1787781973.525555:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:11439:x1874624943029248:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781973.525725:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:11439:x1874624943029248:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781973.525733:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 133 00000100:00100000:2.0:1787781973.532434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.532525:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943029376 00000100:00100000:1.0:1787781973.532748:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943029376 00000100:00100000:1.0:1787781973.532869:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 134 00000100:00100000:1.0:1787781973.532881:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:11439:x1874624943029376:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781973.532907:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781973.532933:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b45 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533019:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533047:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533061:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781973.533116:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781973.533152:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533182:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063c64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b45 expref: 69 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533213:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b45 expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.533244:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:1.0:1787781973.533247:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781973.533252:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa400, rc 0) 00000100:00100000:1.0:1787781973.533741:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:11439:x1874624943029376:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 859us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.533750:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 134 00000100:00100000:2.0:1787781973.539485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.539790:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943029504 00000100:00100000:0.0:1787781973.539802:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943029504 00000100:00100000:0.0:1787781973.539873:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:0.0:1787781973.539884:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943029504:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.539908:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.539935:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b4c expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781973.539967:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6355, blocks: 0x0 00010000:00010000:0.0:1787781973.539992:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1787781973.539998:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781973.540009:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.540042:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.540060:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781973.540151:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943029504:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 268us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.540159:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:3.0:1787781973.542985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.543114:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943029760 00000100:00100000:0.0:1787781973.543126:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943029760 00000100:00100000:0.0:1787781973.543239:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 135 00000100:00100000:0.0:1787781973.543251:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:11439:x1874624943029760:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787781973.543390:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:11439:x1874624943029760:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 141us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.543399:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 135 00000100:00100000:2.0:1787781973.546355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.546452:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943029888 00000100:00100000:0.0:1787781973.546464:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943029888 00000100:00100000:0.0:1787781973.546532:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787781973.546553:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:11439:x1874624943029888:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.546583:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.546798:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b53 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.546911:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.546923:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781973.546928:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781973.546933:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.546977:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.546993:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.547011:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1874624963026944:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781973.547145:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781973.553752:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1874624963026944:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781973.553802:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.553842:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:2.0:1787781973.553927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.554071:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030016 00000100:00100000:0.0:1787781973.554079:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030016 00010000:00010000:0.0:1787781973.554121:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 12 pid: 8446 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.554633:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:11439:x1874624943029888:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 8053us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.554645:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787781973.554746:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:0.0:1787781973.554759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:2409:x1874624943030016:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781973.554778:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781973.554816:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.554831:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.554871:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c15063c72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b4c expref: 11 pid: 8446 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.554889:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781973.554894:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781973.554903:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.554915:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.554955:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.554971:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874624963027072:192.168.206.16@tcp:105: 00000100:00100000:1.0:1787781973.558299:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781973.563633:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874624963027072:192.168.206.16@tcp:105: 00010000:00010000:1.0:1787781973.563680:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781973.563749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943030016:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 8994us (9826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.563762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:1.0:1787781973.566876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.567018:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030144 00000100:00100000:3.0:1787781973.567041:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030144 00002000:00100000:3.0:1787781973.567105:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff993c43edd680 x1874624943030144/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:119/0 lens 504/0 e 0 to 0 dl 1787781984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781973.567118:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43edd680 with x1874624943030144 ext(0->12) 00002000:00010000:3.0:1787781973.567135:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993c43edd680 00000100:00100000:3.0:1787781973.567170:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:3.0:1787781973.567180:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943030144:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787781973.570839:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:2409:x1874624943030144:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 Request processed in 3644us (3971us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787781973.570924:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00002000:00100000:2.0:1787781973.570942:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff993c43edd680 x1874624943030144/t4294967309(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:119/0 lens 504/448 e 0 to 0 dl 1787781984 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781973.570953:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43edd680 with x1874624943030144 ext(0->12) 00002000:00010000:2.0:1787781973.570961:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993c43edd680 00000100:00100000:2.0:1787781973.573995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.574297:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030272 00000100:00100000:0.0:1787781973.574311:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030272 00000100:00100000:0.0:1787781973.574580:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 136 00000100:00100000:0.0:1787781973.574594:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:11439:x1874624943030272:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787781973.577971:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1787781973.577995:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787781973.578052:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787781973.578084:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993c4304b480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787781973.578090:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d799e6e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993c4304b600 00000020:00080000:2.0:1787781973.578094:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d799e6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993d41323400 00000004:00080000:2.0:1787781973.578119:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787781973.578172:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d6d0670c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787781973.578176:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993c4372cf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d6d067780 00000020:00080000:2.0:1787781973.578206:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993c4372c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993d41323c00 00000020:00080000:2.0:1787781973.578234:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787781973.578310:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787781973.578847:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963027328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787781973.578954:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963027200:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781973.579052:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781973.579120:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963027200 00000100:00100000:2.0:1787781973.579142:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963027200 00000100:00100000:2.0:1787781973.579323:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787781973.579408:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963027200:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787781973.579550:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781973.579592:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963027328 00000100:00100000:0.0:1787781973.579597:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963027328 00000100:00100000:0.0:1787781973.579652:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787781973.579659:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963027328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787781973.579791:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787781973.579796:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787781973 00002000:00010000:0.0:1787781973.579799:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787781973.579801:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787781973 -> 1787781973 00002000:00010000:0.0:1787781973.579803:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787781973.579849:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3659:x1874624963027328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (298us total) trans 4294967310 rc 0/0 00002000:00080000:2.0:1787781973.579962:0:13830:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1787781973.579987:0:13830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.580012:0:13830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.580032:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787781973.580037:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781973.580043:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.580080:0:13830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.580097:0:13830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.580424:0:13830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13830:1874624963027456:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781973.580596:0:13830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066900 going to sleep for 11 seconds 00000100:00100000:0.0:1787781973.581056:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1787781973.581139:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43e43840/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787781973.581148:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963027328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787781973.581160:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781973.581168:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963027584:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787781973.582119:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787781973.582899:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582916:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582924:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582930:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.582935:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582944:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582962:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff993c436a7300) 00010000:00010000:3.0:1787781973.582966:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.582971:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.582999:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506397e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583044:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583052:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583058:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583063:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.583067:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583073:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583083:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff993c42528300) 00010000:00010000:3.0:1787781973.583085:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.583089:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583095:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063a26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583111:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583116:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583142:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583148:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.583151:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583158:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583167:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:3.0:1787781973.583170:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.583173:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583179:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063aa4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583192:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583199:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583205:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583210:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.583213:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583233:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583241:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d6d097100) 00010000:00010000:3.0:1787781973.583243:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.583246:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583251:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15063ac7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583266:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583273:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583278:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583284:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.583286:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583292:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583299:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781973.583302:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.583305:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583321:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063b99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583350:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583357:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583362:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583367:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.583370:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583376:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583384:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:3.0:1787781973.583387:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787781973.583390:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.583395:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063c56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.589261:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11439:x1874624943030272:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 Request processed in 14654us (15262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.589279:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 136 00000100:00100000:0.0:1787781973.590818:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781973.590947:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963027584 00000100:00100000:1.0:1787781973.590957:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963027584 00000100:00100000:1.0:1787781973.591036:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787781973.591048:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963027584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787781973.591086:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1787781973.591137:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6353, atime: 0x6a8f6354, ctime: 0x6a8f6353, blocks: 0x8 00010000:00010000:1.0:1787781973.591147:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591166:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1787781973.591192:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781973.591199:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591218:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591229:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591236:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591255:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1787781973.591465:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781973.591915:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963027584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 867us (1103us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787781973.591924:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787781973.591954:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781973.591961:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591970:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbe00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781973.591974:0:10349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.591983:0:10349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.592031:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.592041:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003574206c/0xc6d6745c15063c87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.592062:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781973.592064:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781973.592066:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787781973.592383:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43edc000/2, rc 0, transno 4294967305 00000100:00100000:0.0:1787781973.592392:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963027584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787781973.592424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.592507:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030400 00000100:00100000:0.0:1787781973.592513:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030400 00000100:00100000:2.0:1787781973.592531:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00010000:00010000:0.0:1787781973.592681:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 12 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.592713:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:0.0:1787781973.592733:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:2408:x1874624943030400:12345-192.168.206.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787781973.592746:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030528 00000100:00100000:3.0:1787781973.592750:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030528 00010000:00010000:0.0:1787781973.592752:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781973.592757:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 13 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.592772:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 13 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.592776:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:3.0:1787781973.592782:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2406:x1874624943030528:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787781973.592795:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781973.592799:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781973.592804:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.592814:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.592832:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781973.592883:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2408:x1874624943030400:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 152us (460us total) trans 0 rc 0/0 00010000:00010000:1.0:1787781973.592943:0:13830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15063a34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aab expref: 13 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.592959:0:13830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13830:1874624963027456:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781973.593085:0:13830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593096:0:13830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593104:0:13830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593113:0:13830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593148:0:13830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593167:0:13830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787781973.593345:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3658:x1874624963027200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14002us (14282us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787781973.593353:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1787781973.593379:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781973.593385:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593393:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781973.593398:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593406:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593422:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.593429:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039bb3774/0xc6d6745c15063c80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.594061:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781973.594074:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781973.594077:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787781973.594114:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993d4c0e8000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787781973.594136:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963027200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787781973.596159:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 73 00000001:00080000:3.0:1787781973.597768:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787781973.597785:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787781973.598080:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943030528:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 Request processed in 5292us (5543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.598093:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:2.0:1787781973.604093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.604190:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030784 00000100:00100000:3.0:1787781973.604205:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030784 00000100:00100000:3.0:1787781973.604272:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:3.0:1787781973.604282:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11439:x1874624943030784:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781973.604334:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781973.604360:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063c6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b45 expref: 16 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.604379:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:3.0:1787781973.604384:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781973.604412:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.604426:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.604436:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781973.604546:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000583b0dc4 reply state 000000008ee9869e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.604559:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.604566:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:3.0:1787781973.604569:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781973.604600:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781973.604971:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11439:x1874624943030784:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 689us (890us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1787781973.604979:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:1.0:1787781973.610670:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.610775:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943030912 00000100:00100000:3.0:1787781973.610790:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943030912 00000100:00100000:3.0:1787781973.610877:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:2.0:1787781973.611039:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943030912:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787781973.611223:0:8638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787781973.611227:0:8638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787781973 -> 1787781972 00002000:00010000:2.0:1787781973.611229:0:8638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787781972 00002000:00010000:2.0:1787781973.611232:0:8638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787781973 -> 1787781972 00002000:00010000:2.0:1787781973.611234:0:8638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787781973.611299:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943030912:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 411us (638us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787781973.611309:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:1.0:1787781973.615296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781973.615387:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031168 00000100:00100000:2.0:1787781973.615397:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031168 00000100:00100000:2.0:1787781973.615459:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:2.0:1787781973.615471:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:11439:x1874624943031168:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787781973.615535:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.615554:0:10060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.615577:0:10060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.615658:0:10060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.615672:0:10060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.615686:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963027712:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781973.615759:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066180 going to sleep for 11 seconds 00000100:00100000:1.0:1787781973.623958:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963027712:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781973.624000:0:10060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.624488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.624674:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031296 00000100:00100000:3.0:1787781973.624684:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031296 00010000:00010000:3.0:1787781973.624742:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 18 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.624784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:3.0:1787781973.624796:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2409:x1874624943031296:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781973.624814:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781973.624821:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 18 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624836:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 18 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624875:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063c4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b37 expref: 18 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624895:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:3.0:1787781973.624900:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624910:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624927:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.624959:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781973.625033:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:2409:x1874624943031296:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 228us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781973.625043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 74 00010000:00010000:1.0:1787781973.625067:0:10060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625077:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625126:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625134:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625268:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625277:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781973.625282:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625292:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625373:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:1.0:1787781973.625376:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787781973.625380:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.625386:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063c95 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.625492:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11439:x1874624943031168:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 Request processed in 10023us (10203us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787781973.625500:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:1.0:1787781973.632762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.633251:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031424 00000100:00100000:3.0:1787781973.633263:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031424 00000100:00100000:3.0:1787781973.633334:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:3.0:1787781973.633346:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943031424:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787781973.633400:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.633424:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.633435:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781973.633439:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781973.633445:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.633488:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.633505:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 7 pid: 8445 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.633537:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1874624963027840:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781973.633940:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781973.638682:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1874624963027840:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781973.638719:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.638852:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.638974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031552 00000100:00100000:0.0:1787781973.638982:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031552 00010000:00010000:0.0:1787781973.639039:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 8 pid: 8445 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.639106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:0.0:1787781973.639117:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943031552:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781973.639146:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781973.639523:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 8 pid: 8445 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.639539:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 8 pid: 8445 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.639569:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c15063c79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b53 expref: 8 pid: 8445 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.639588:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781973.639593:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781973.639599:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.640087:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.640131:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781973.640224:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943031552:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 1106us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781973.640234:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 75 00010000:00010000:1.0:1787781973.640723:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640748:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640776:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640785:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640793:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640818:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781973.640827:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640837:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640855:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.640862:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15063c9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.640936:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943031424:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 Request processed in 7591us (8187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.640946:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:2.0:1787781973.644233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.644320:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031808 00000100:00100000:3.0:1787781973.644331:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031808 00000100:00100000:3.0:1787781973.644432:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:3.0:1787781973.644443:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:11439:x1874624943031808:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787781973.644546:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.644565:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.644575:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.644649:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.644663:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 16 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.644699:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963027968:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781973.644809:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781973.647972:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963027968:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781973.648012:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.649856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.650016:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943031936 00000100:00100000:1.0:1787781973.650034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943031936 00010000:00010000:1.0:1787781973.650083:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.650313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:1.0:1787781973.650326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:2408:x1874624943031936:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781973.650345:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781973.650361:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650376:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650403:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063b92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83aff expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650424:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781973.650430:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650442:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650449:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650457:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.650497:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781973.650658:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650667:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650874:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650886:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650895:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650929:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.650944:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.650958:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963028096:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781973.651205:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:2408:x1874624943031936:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 879us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.651214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:0.0:1787781973.651601:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781973.655518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.656090:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963028096:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781973.656126:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.656442:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943032064 00000100:00100000:2.0:1787781973.656451:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943032064 00010000:00010000:2.0:1787781973.656499:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781973.656590:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 77 00000100:00100000:2.0:1787781973.656600:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:2409:x1874624943032064:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781973.656639:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781973.656647:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656662:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656705:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063c5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b3e expref: 17 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656723:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:2.0:1787781973.656728:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656738:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656747:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781973.656778:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781973.656846:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:2409:x1874624943032064:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 247us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781973.656855:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 77 00010000:00010000:3.0:1787781973.657852:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.657867:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781973.658001:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1787781973.658151:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1787781973.658212:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1787781973.658314:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963028224:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787781973.658400:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781973.658488:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43e55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781973.658947:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963028224 00000100:00100000:1.0:1787781973.658958:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963028224 00000100:00100000:1.0:1787781973.659098:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787781973.659109:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963028224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787781973.659267:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963028224:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.659275:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787781973.659353:0:6532:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787781973.659371:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1787781973.659396:0:6532:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43e43840, transno 4294967310 00000004:00080000:0.0:1787781973.659414:0:6532:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993d4c0e8000, transno 4294967311 00000100:00100000:0.0:1787781973.659422:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f65680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963028224:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787781973.659589:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787781973.659676:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963028352:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787781973.659717:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781973.660306:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781973.660381:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963028352 00000100:00100000:3.0:1787781973.660390:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963028352 00000100:00100000:3.0:1787781973.660425:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787781973.660433:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963028352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787781973.660588:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6532:x1874624963028352:12345-0@lo:1000:mdt00_001.0 Request processed in 155us (870us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787781973.660627:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787781973.660802:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963028352:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787781973.660851:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660861:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660869:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660876:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781973.660881:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660889:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660907:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781973.660910:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781973.660916:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660921:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063caa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660950:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660962:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660968:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660973:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfba00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781973.660976:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660982:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.660992:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781973.660994:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781973.661001:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.661013:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.661030:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.661064:0:6532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.661078:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963028480:192.168.206.16@tcp:105: 00000100:00100000:0.0:1787781973.661319:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781973.663868:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963028480:192.168.206.16@tcp:105: 00010000:00010000:1.0:1787781973.663906:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.663918:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063bed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664142:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664159:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664171:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664182:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664189:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664196:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664202:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781973.664206:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664232:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664246:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781973.664249:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781973.664253:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664259:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063cb1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664269:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664276:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664281:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664286:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781973.664288:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664294:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664302:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781973.664304:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781973.664307:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.664322:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063ca3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.664447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.664581:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11439:x1874624943031808:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 20139us (20360us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787781973.664594:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 139 00000040:00080000:0.0:1787781973.664653:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781973.664659:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000020:00080000:1.0:1787781973.664681:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787781973.665218:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787781973.665229:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781973.665625:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943032192 00000100:00100000:2.0:1787781973.665635:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943032192 00000100:00100000:2.0:1787781973.665695:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:2.0:1787781973.665707:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:11438:x1874624943032192:12345-192.168.206.16@tcp:49:lfs.0 00000100:00100000:3.0:1787781973.667961:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.668153:0:6535:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787781973.668317:0:6535:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1787781973.668727:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943032448 00000100:00100000:0.0:1787781973.668739:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943032448 00000100:00100000:1.0:1787781973.668916:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 32 00000100:00100000:1.0:1787781973.668927:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:11439:x1874624943032448:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787781973.669412:0:14286:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787781973.669447:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1787781973.669484:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669503:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669516:0:14286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669525:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669531:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669538:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781973.669570:0:14286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787781973.669988:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781973.669997:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.670005:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781973.670010:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.670019:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.670043:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781973.670046:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787781973.670051:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.670059:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063cb8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.670073:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781973.670075:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781973.670077:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781973.670109:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11439:x1874624943032448:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 1182us (2157us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787781973.670118:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 32 00000020:00080000:1.0:1787781973.670124:0:14286:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787781973.670344:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11438:x1874624943032192:12345-192.168.206.16@tcp:49:lfs.0 Request processed in 4638us (5896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781973.670352:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:2.0:1787781973.673988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781973.674076:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943032704 00000100:00100000:1.0:1787781973.674088:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943032704 00000100:00100000:1.0:1787781973.674158:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:1.0:1787781973.674178:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11438:x1874624943032704:12345-192.168.206.16@tcp:58:lfs.0 00000040:00080000:1.0:1787781973.674399:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787781973.674496:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11438:x1874624943032704:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 329us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781973.674504:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:2.0:1787781973.722972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.723146:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943032832 00000100:00100000:0.0:1787781973.723158:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943032832 00000100:00100000:0.0:1787781973.723254:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 141 00000100:00100000:0.0:1787781973.723266:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:11441:x1874624943032832:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781973.723289:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781973.723313:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063cbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b5a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723396:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723411:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723425:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723442:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723449:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723455:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723540:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723552:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723562:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723777:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781973.723793:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 22 pid: 6532 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781973.723808:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963028608:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781973.723914:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781973.726871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781973.727086:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963028608:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781973.727122:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781973.727294:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033088 00000100:00100000:1.0:1787781973.727303:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033088 00000100:00100000:1.0:1787781973.727413:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:1.0:1787781973.727425:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:6189:x1874624943033088:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787781973.727849:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:6189:x1874624943033088:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 426us (993us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787781973.727857:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:2.0:1787781973.729952:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781973.730064:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033216 00000100:00100000:3.0:1787781973.730074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033216 00010000:00010000:3.0:1787781973.730116:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 24 pid: 6532 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781973.730164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 78 00000100:00100000:3.0:1787781973.730173:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:2408:x1874624943033216:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781973.730198:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781973.730206:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 24 pid: 6532 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730220:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 24 pid: 6532 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730246:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063bdf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b1b expref: 24 pid: 6532 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730266:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781973.730272:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730282:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730331:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781973.730434:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:2408:x1874624943033216:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 262us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781973.730442:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 78 00010000:00010000:3.0:1787781973.730791:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730800:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781973.730857:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787781973.730862:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781973.730884:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730899:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730909:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730916:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730922:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730929:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.730941:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730950:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730961:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:3.0:1787781973.730964:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.730968:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730976:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063cc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730989:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.730995:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731002:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731007:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781973.731011:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731017:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731037:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff993d679e1000) 00010000:00010000:3.0:1787781973.731039:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781973.731048:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731054:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063ccd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731096:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063cbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b5a expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731110:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b5a expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781973.731116:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:3.0:1787781973.731118:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781973.731120:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167600, rc 0) 00000100:00100000:3.0:1787781973.731155:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11441:x1874624943032832:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 7892us (8196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781973.731163:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 141 00010000:00010000:3.0:1787781974.097247:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781974.510344:0:14324:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781974.510353:0:14324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781974.510385:0:14324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787781974.510393:0:14324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781974.536879:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781974.536905:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963028736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781974.536970:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781974.537749:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963028736 00000100:00100000:3.0:1787781974.537758:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963028736 00000100:00100000:3.0:1787781974.537805:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787781974.537814:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963028736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781974.537848:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781974.538118:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963028736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 304us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781974.538133:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787781974.538191:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963028736:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787781974.725830:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781974.725839:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781974.725866:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787781974.725878:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781974.726003:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963028864:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781974.726122:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781974.727970:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963028864:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781974.738317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781974.741832:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033344 00000100:00100000:1.0:1787781974.741846:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033344 00000100:00100000:2.0:1787781974.743350:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 142 00000100:00100000:2.0:1787781974.743363:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11453:x1874624943033344:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781974.743401:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781974.743527:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11453:x1874624943033344:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 166us (5219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781974.743536:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 142 00000100:00100000:3.0:1787781974.748249:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781974.748655:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033600 00000100:00100000:1.0:1787781974.748665:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033600 00000100:00100000:1.0:1787781974.748720:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 143 00000100:00100000:1.0:1787781974.748730:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:11453:x1874624943033600:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781974.748752:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781974.748774:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063cdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781974.748878:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063ce2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781974.748892:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781974.748904:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781974.748915:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787781974.749011:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063cdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b61 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781974.749042:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b61 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781974.749052:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787781974.749055:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781974.749058:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfae00, rc 0) 00000100:00100000:1.0:1787781974.749118:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:11453:x1874624943033600:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 389us (878us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787781974.749145:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 143 00000100:00100000:3.0:1787781974.756861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781974.756910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781974.756999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033728 00000100:00100000:0.0:1787781974.757009:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033728 00000100:00100000:0.0:1787781974.757096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:0.0:1787781974.757107:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:2408:x1874624943033728:12345-192.168.206.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787781974.757113:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943033984 00000100:00100000:2.0:1787781974.757119:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943033984 00010000:00010000:0.0:1787781974.757123:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781974.757151:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063ce2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b61 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781974.757165:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 144 00000100:00100000:2.0:1787781974.757188:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:11453:x1874624943033984:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787781974.757190:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781974.757198:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781974.757252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:2408:x1874624943033728:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 147us (399us total) trans 0 rc 0/0 00010000:00010000:2.0:1787781974.757259:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781974.757260:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00010000:00010000:2.0:1787781974.757277:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757289:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757432:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757439:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757445:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757451:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781974.757462:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757471:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757479:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:2.0:1787781974.757482:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781974.757486:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781974.757492:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15063cf0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781974.757584:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:11453:x1874624943033984:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 408us (673us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787781974.757592:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 144 00000040:00080000:0.0:1787781974.757840:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781974.757845:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781974.758589:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787781974.758601:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781974.762719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781974.762845:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943034240 00000100:00100000:1.0:1787781974.762854:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943034240 00000100:00100000:1.0:1787781974.762916:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:1.0:1787781974.762926:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:11453:x1874624943034240:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787781974.763289:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:11453:x1874624943034240:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 363us (576us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787781974.763298:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 34 00010000:00010000:1.0:1787781975.110106:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781976.136027:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781976.364285:0:14377:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781976.364295:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781976.364328:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787781976.364334:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781976.557551:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781976.558313:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943034496 00000100:00100000:0.0:1787781976.558322:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943034496 00000100:00100000:0.0:1787781976.558393:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00100000:0.0:1787781976.558403:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:11473:x1874624943034496:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781976.558425:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781976.558445:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063cf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b68 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781976.558544:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063cfe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781976.558558:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063cfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781976.558570:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063cfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781976.558581:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787781976.558727:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063cf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b68 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781976.558743:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063cfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b68 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781976.558751:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:0.0:1787781976.558754:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787781976.558757:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167200, rc 0) 00000100:00100000:0.0:1787781976.558809:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:11473:x1874624943034496:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 408us (1268us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787781976.558817:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00080000:1.0:1787781976.559446:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781976.561729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781976.561944:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943034624 00000100:00100000:2.0:1787781976.561954:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943034624 00000100:00100000:2.0:1787781976.562021:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 146 00000100:00100000:2.0:1787781976.562031:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:11473:x1874624943034624:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:2.0:1787781976.562093:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562110:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562131:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562164:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562171:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562178:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562184:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781976.562188:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562196:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562206:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:2.0:1787781976.562209:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781976.562213:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.562219:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4c00/0xc6d6745c15063d0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.562343:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:11473:x1874624943034624:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 313us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.562351:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 146 00000100:00100000:1.0:1787781976.581866:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963028992:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.581938:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781976.582118:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963028992 00000100:00100000:2.0:1787781976.582139:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963028992 00000100:00100000:2.0:1787781976.582183:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787781976.582191:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963028992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582354:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963029120:0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582389:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781976.582415:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781976.582420:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963029248:0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582443:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781976.582470:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029248 00000100:00100000:0.0:1787781976.582474:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029248 00000100:00100000:0.0:1787781976.582502:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787781976.582507:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582544:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963029248:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.582551:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787781976.582589:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963029248:0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582624:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029120 00000100:00100000:0.0:1787781976.582628:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029120 00000100:00100000:0.0:1787781976.582662:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787781976.582669:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963029120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.582705:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963029120:12345-0@lo:400:kworker.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.582712:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787781976.582739:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963029120:0@lo:400:kworker.0 00000100:00100000:2.0:1787781976.585797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963028992:12345-0@lo:400:kworker.0 Request processed in 3596us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.585811:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787781976.586003:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963029376:0@lo:400:kworker.0 00000100:00100000:2.0:1787781976.586060:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781976.586102:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781976.586108:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963029504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781976.586134:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781976.586226:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029376 00000100:00100000:0.0:1787781976.586233:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029376 00000100:00100000:0.0:1787781976.586282:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787781976.586291:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963029376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.586341:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963029376:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.586347:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787781976.586381:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963029376:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.590576:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963028992:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591161:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029504 00000100:00100000:3.0:1787781976.591170:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029504 00000100:00100000:3.0:1787781976.591227:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787781976.591238:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963029504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781976.591274:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787781976.591410:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963029504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.591419:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787781976.591477:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781976.591488:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963029632:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591524:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781976.591568:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963029760:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591592:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781976.591665:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781976.591671:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030144:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591697:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781976.591733:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963030272:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591756:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781976.591842:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781976.591850:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c44520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030656:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.591874:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781976.591962:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030144 00000100:00100000:0.0:1787781976.591967:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030144 00000100:00100000:0.0:1787781976.592028:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030656 00000100:00100000:0.0:1787781976.592031:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030656 00000100:00100000:0.0:1787781976.592057:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787781976.592065:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1874624963030144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.592107:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1874624963030144:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.592113:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787781976.592126:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787781976.592132:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963030656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.592161:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963030656:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.592174:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787781976.592202:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029632 00000100:00100000:0.0:1787781976.592206:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029632 00000100:00100000:0.0:1787781976.592230:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787781976.592237:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.592271:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963029632:12345-0@lo:400:kworker.0 Request processed in 35us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.592277:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787781976.592297:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029760 00000100:00100000:0.0:1787781976.592301:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029760 00000100:00100000:0.0:1787781976.592326:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030272 00000100:00100000:0.0:1787781976.592328:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030272 00000100:00100000:0.0:1787781976.592346:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787781976.592352:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.592381:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963029760:12345-0@lo:400:kworker.0 Request processed in 29us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.592387:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787781976.592399:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787781976.592405:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963030272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.592429:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963030272:12345-0@lo:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.592435:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1787781976.593820:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781976.593828:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781976.593831:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781976.593876:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c44520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030656:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.593891:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963030272:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.593903:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030144:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.593913:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963029760:0@lo:400:kworker.0 00000100:00100000:3.0:1787781976.593924:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963029632:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.594226:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963030016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.594281:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781976.594314:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c445203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963030528:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.594335:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781976.594359:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787781976.594365:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963029888:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.594386:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781976.594401:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963030400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781976.594420:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781976.594488:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963029888 00000100:00100000:0.0:1787781976.594493:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963029888 00000100:00100000:0.0:1787781976.594543:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030400 00000100:00100000:0.0:1787781976.594546:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030400 00000100:00100000:0.0:1787781976.594569:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787781976.594592:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594661:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963029888:12345-0@lo:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.594668:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787781976.594683:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787781976.594689:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963030400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594714:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963030400:12345-0@lo:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.594720:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787781976.594740:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030016 00000100:00100000:0.0:1787781976.594743:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030016 00000100:00100000:0.0:1787781976.594767:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030528 00000100:00100000:0.0:1787781976.594769:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030528 00000100:00100000:0.0:1787781976.594786:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787781976.594792:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594838:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963030016:12345-0@lo:400:kworker.0 Request processed in 46us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.594845:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787781976.594858:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787781976.594864:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963030528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594888:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963030528:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.594893:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:0.0:1787781976.594930:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa9e580 x1874624963029888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781976.594941:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963029888:0@lo:400:kworker.0 00010000:00080000:0.0:1787781976.594961:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d7fa9f480 x1874624963030400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781976.594969:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963030400:0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594978:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963030016:0@lo:400:kworker.0 00000100:00100000:0.0:1787781976.594986:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c445203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963030528:0@lo:400:kworker.0 00000100:00080000:1.0:1787781976.595292:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781976.595302:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781976.595305:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787781976.596862:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963029504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787781976.650896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781976.651038:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943034752 00000100:00100000:2.0:1787781976.651048:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943034752 00000100:00100000:2.0:1787781976.651131:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:2.0:1787781976.651141:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624943034752:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:2.0:1787781976.651159:0:8638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787781976.651359:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787781976.651405:0:8638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c15063d13 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b6f expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781976.651431:0:8638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6354, atime: 0x6a8f6354, ctime: 0x6a8f6354, blocks: 0x8 00010000:00010000:2.0:1787781976.651450:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1787781976.651456:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781976.651466:0:8638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c15063d13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b6f expref: 7 pid: 8638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.651508:0:8638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c15063d13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b6f expref: 7 pid: 8638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.651522:0:8638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4c00, rc 0) 00000100:00100000:2.0:1787781976.651596:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943034752:12345-192.168.206.16@tcp:101:cat.0 Request processed in 456us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.651894:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:0.0:1787781976.659762:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781976.659858:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943034880 00000100:00100000:2.0:1787781976.659869:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943034880 00002000:00100000:2.0:1787781976.659920:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff993c43ec9e00 x1874624943034880/t0(0) o3->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:122/0 lens 488/0 e 0 to 0 dl 1787781987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781976.659932:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43ec9e00 with x1874624943034880 ext(0->4095) 00002000:00010000:2.0:1787781976.659939:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993c43ec9e00 00000100:00100000:2.0:1787781976.659973:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:2.0:1787781976.659982:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943034880:12345-192.168.206.16@tcp:3:cat.0 00000100:00100000:2.0:1787781976.660341:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943034880:12345-192.168.206.16@tcp:3:cat.0 Request processed in 357us (744us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787781976.660353:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00002000:00100000:2.0:1787781976.660361:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff993c43ec9e00 x1874624943034880/t0(0) o3->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:122/0 lens 488/4536 e 0 to 0 dl 1787781987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781976.660369:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43ec9e00 with x1874624943034880 ext(0->4095) 00002000:00010000:2.0:1787781976.660372:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993c43ec9e00 00000100:00100000:1.0:1787781977.093939:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963030912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787781977.094021:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781977.094153:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781977.094193:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781977.094275:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030912 00000100:00100000:3.0:1787781977.094283:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030912 00000100:00100000:3.0:1787781977.094332:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963030784 00000100:00100000:3.0:1787781977.094336:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963030784 00000100:00100000:3.0:1787781977.094350:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781977.094358:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963030912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781977.094389:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781977.094438:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963030912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.094445:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781977.094462:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787781977.094468:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963030784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781977.094477:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781977.094502:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963030784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.094522:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787781977.102692:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963030784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781977.102743:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963030912:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787781977.157891:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781977.480314:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781977.480477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781977.481066:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035008 00000100:00100000:0.0:1787781977.481078:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035008 00000100:00100000:0.0:1787781977.481131:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 383 00000100:00100000:0.0:1787781977.481141:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624943035008:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481211:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d58e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624943035008:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 70us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481218:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 383 00000100:00100000:0.0:1787781977.481253:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035520 00000100:00100000:0.0:1787781977.481257:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035520 00000100:00100000:0.0:1787781977.481295:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035392 00000100:00100000:0.0:1787781977.481299:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035392 00000100:00100000:0.0:1787781977.481321:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 144 00000100:00100000:0.0:1787781977.481328:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943035520:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481359:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943035520:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 31us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481365:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 144 00000100:00100000:0.0:1787781977.481392:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00100000:0.0:1787781977.481398:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44520780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943035392:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481425:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44520780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943035392:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481432:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00100000:0.0:1787781977.481452:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035264 00000100:00100000:0.0:1787781977.481456:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035264 00000100:00100000:0.0:1787781977.481478:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035776 00000100:00100000:0.0:1787781977.481481:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035776 00000100:00100000:0.0:1787781977.481495:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035136 00000100:00100000:0.0:1787781977.481498:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035136 00000100:00100000:0.0:1787781977.481508:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035648 00000100:00100000:0.0:1787781977.481510:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035648 00000100:00100000:0.0:1787781977.481525:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 306 00000100:00100000:0.0:1787781977.481532:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943035264:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481560:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943035264:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481567:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 306 00000100:00100000:0.0:1787781977.481579:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 307 00000100:00100000:0.0:1787781977.481585:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c445212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943035776:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481623:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c445212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943035776:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 22us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481629:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 307 00000100:00100000:0.0:1787781977.481641:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 308 00000100:00100000:0.0:1787781977.481647:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:2407:x1874624943035136:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481669:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:2407:x1874624943035136:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 23us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481683:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 308 00000100:00100000:0.0:1787781977.481696:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 309 00000100:00100000:0.0:1787781977.481702:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c445230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943035648:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781977.481726:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c445230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943035648:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.481732:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 309 00000100:00080000:1.0:1787781977.481944:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781977.481949:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787781977.481952:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781977.606538:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c44520f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963031040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781977.606627:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781977.607177:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781977.607212:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781977.607730:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031040 00000100:00100000:2.0:1787781977.607745:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031040 00000100:00100000:2.0:1787781977.607794:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031168 00000100:00100000:2.0:1787781977.607798:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031168 00000100:00100000:2.0:1787781977.607815:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787781977.607824:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963031040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781977.607829:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787781977.607838:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963031168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781977.607851:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:0.0:1787781977.607851:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787781977.607894:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963031040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.607901:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787781977.607902:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963031168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.607907:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787781977.608117:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781977.608155:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c44520f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963031040:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1787781978.120897:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1787781978.120913:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:3.0:1787781978.183557:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787781978.246940:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1787781978.638292:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787781978.638330:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d772fd6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787781978.638336:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d67f52d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d772fd900 00000020:00080000:1.0:1787781978.638338:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d67f52f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993d47f2c000 00000020:00080000:1.0:1787781978.638365:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1787781978.638566:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638578:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638586:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638593:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781978.638597:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638625:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638657:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff993d679e1a00) 00010000:00010000:0.0:1787781978.638660:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781978.638665:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781978.638673:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063c8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781978.638775:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787781978.638800:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:2.0:1787781978.639438:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787781978.639509:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:0.0:1787781978.886876:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781978.886884:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781978.886903:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787781978.886910:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787781979.213305:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781979.653999:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781979.654022:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963031296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781979.654091:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781979.654162:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031296 00000100:00100000:1.0:1787781979.654171:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031296 00000100:00100000:1.0:1787781979.654226:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787781979.654236:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963031296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787781979.654270:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787781979.654332:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963031296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781979.654340:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787781979.654462:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963031296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787781980.230755:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781981.254096:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781981.493136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781981.493251:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943035904 00000100:00100000:2.0:1787781981.493261:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943035904 00000100:00100000:2.0:1787781981.493344:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 147 00000100:00100000:2.0:1787781981.493355:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11118:x1874624943035904:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787781981.493469:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11118:x1874624943035904:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781981.493477:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 147 00000100:00080000:1.0:1787781981.493555:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781981.495884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781981.496099:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036032 00000100:00100000:2.0:1787781981.496108:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036032 00000100:00100000:2.0:1787781981.496216:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 148 00000100:00100000:2.0:1787781981.496226:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:11118:x1874624943036032:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787781981.496326:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:11118:x1874624943036032:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781981.496335:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 148 00000100:00080000:1.0:1787781981.496420:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781981.502912:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781981.503054:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036288 00000100:00100000:0.0:1787781981.503070:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036288 00000100:00100000:0.0:1787781981.503149:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:0.0:1787781981.503160:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:11118:x1874624943036288:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787781981.503414:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:11118:x1874624943036288:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 254us (515us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787781981.503422:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:1.0:1787781981.701990:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963031424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781981.702063:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781981.702256:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031424 00000100:00100000:3.0:1787781981.702264:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031424 00000100:00100000:3.0:1787781981.702316:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787781981.702325:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963031424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781981.702359:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787781981.702408:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963031424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.702415:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787781981.708397:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963031424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781981.708430:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781981.708439:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963031552:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.708509:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.710905:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963031936:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.710967:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.711050:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031936 00000100:00100000:0.0:1787781981.711057:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031936 00000100:00100000:0.0:1787781981.711102:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787781981.711110:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963031936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711162:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963031936:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.711169:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787781981.711216:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963031936:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711251:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781981.711258:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963032064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711284:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.711311:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032064 00000100:00100000:0.0:1787781981.711315:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032064 00000100:00100000:0.0:1787781981.711351:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787781981.711358:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963032064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711392:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963032064:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.711398:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1787781981.711417:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781981.711434:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963032064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711476:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963032448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711502:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.711530:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032448 00000100:00100000:0.0:1787781981.711533:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032448 00000100:00100000:0.0:1787781981.711563:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787781981.711570:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963032448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711652:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963032448:12345-0@lo:400:kworker.0 Request processed in 82us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.711658:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1787781981.711676:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781981.711691:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787781981.711697:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1787781981.711728:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963032448:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711758:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781981.711765:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963032576:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711789:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.711811:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032576 00000100:00100000:0.0:1787781981.711814:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032576 00000100:00100000:0.0:1787781981.711844:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787781981.711851:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963032576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711884:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963032576:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.711890:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1787781981.711904:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781981.711921:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963032576:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711960:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963032960:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.711995:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781981.712020:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032960 00000100:00100000:0.0:1787781981.712023:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032960 00000100:00100000:0.0:1787781981.712050:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787781981.712056:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.712088:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963032960:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.712100:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787781981.712117:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781981.712130:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787781981.712135:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787781981.712149:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43edc000, transno 4294967305 00000100:00100000:0.0:1787781981.712160:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963032960:0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.712702:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031552 00000100:00100000:3.0:1787781981.712777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031552 00000100:00100000:3.0:1787781981.712822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787781981.713015:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963031552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.713072:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963031552:12345-0@lo:400:kworker.0 Request processed in 243us (4562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.713078:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787781981.713124:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963031552:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713150:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963031808:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713187:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713225:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963032320:0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.713245:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031808 00000100:00100000:3.0:1787781981.713250:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031808 00000100:00100000:1.0:1787781981.713251:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713275:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963032832:0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.713286:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787781981.713297:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713316:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787781981.713330:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963031680:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713351:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713367:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963032192:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713384:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713401:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963032704:0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713432:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781981.713454:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032320 00000100:00100000:1.0:1787781981.713458:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032320 00000100:00100000:1.0:1787781981.713488:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032832 00000100:00100000:1.0:1787781981.713491:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032832 00000100:00100000:1.0:1787781981.713509:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787781981.713515:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963032320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713549:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963032320:12345-0@lo:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781981.713554:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787781981.713565:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787781981.713570:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963032832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781981.713592:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963032832:12345-0@lo:400:kworker.0 Request processed in 22us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781981.713597:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787781981.713857:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.713893:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963031808:12345-0@lo:400:kworker.0 Request processed in 43us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.713900:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787781981.713914:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963031680 00000100:00100000:3.0:1787781981.713918:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963031680 00000100:00100000:3.0:1787781981.713932:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032192 00000100:00100000:3.0:1787781981.713934:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032192 00000100:00100000:3.0:1787781981.713948:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963032704 00000100:00100000:3.0:1787781981.713951:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963032704 00000100:00100000:3.0:1787781981.713964:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787781981.713970:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963031680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.714012:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963031680:12345-0@lo:400:kworker.0 Request processed in 42us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.714018:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787781981.714031:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787781981.714037:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963032192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.714062:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963032192:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.714068:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787781981.714079:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787781981.714085:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781981.714113:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963032704:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.714127:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:3.0:1787781981.715051:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787781981.715058:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781981.715061:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781981.716664:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963031680:0@lo:400:kworker.0 00010000:00080000:2.0:1787781981.716684:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fe1a40 x1874624963032192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781981.716695:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963032192:0@lo:400:kworker.0 00010000:00080000:2.0:1787781981.716707:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fe3840 x1874624963032704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781981.716715:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963032704:0@lo:400:kworker.0 00000100:00100000:2.0:1787781981.716726:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963031808:0@lo:400:kworker.0 00000100:00100000:2.0:1787781981.716737:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963032320:0@lo:400:kworker.0 00000100:00100000:2.0:1787781981.716747:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963032832:0@lo:400:kworker.0 00000100:00100000:0.0:1787781981.751679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781981.751798:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036416 00000100:00100000:3.0:1787781981.751808:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036416 00000100:00100000:3.0:1787781981.751878:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 149 00000100:00100000:3.0:1787781981.751887:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:11931:x1874624943036416:12345-192.168.206.16@tcp:101:lsof.0 00010000:00010000:3.0:1787781981.751906:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781981.751926:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.751997:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.752011:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.752023:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781981.752069:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787781981.752072:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781981.752112:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.752135:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.752152:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781981.752174:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:3.0:1787781981.752178:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781981.752181:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781981.752245:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:11931:x1874624943036416:12345-192.168.206.16@tcp:101:lsof.0 Request processed in 358us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781981.752251:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 149 00000100:00080000:0.0:1787781981.752381:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781982.214120:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781982.214141:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963033216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781982.214168:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963033088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781982.214211:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.214244:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033216 00000100:00100000:3.0:1787781982.214252:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033216 00000100:00100000:2.0:1787781982.214289:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.214301:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033088 00000100:00100000:3.0:1787781982.214306:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033088 00000100:00100000:3.0:1787781982.214328:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787781982.214336:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787781982.214338:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963033216:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781982.214350:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963033088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781982.214373:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787781982.214373:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787781982.214432:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963033216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781982.214436:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963033088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.214445:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787781982.214519:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963033216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781982.214571:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963033088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781982.218340:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:3.0:1787781982.278462:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781982.603985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781982.604176:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037056 00000100:00100000:0.0:1787781982.604185:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037056 00000100:00100000:0.0:1787781982.604239:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036928 00000100:00100000:0.0:1787781982.604243:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036928 00000100:00100000:0.0:1787781982.604268:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:0.0:1787781982.604277:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943037056:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604343:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943037056:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604350:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:0.0:1787781982.604367:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00100000:0.0:1787781982.604373:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943036928:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604421:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2406:x1874624943036928:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604427:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00080000:0.0:1787781982.604451:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781982.604455:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781982.604465:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036800 00000100:00100000:0.0:1787781982.604468:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036800 00000100:00100000:0.0:1787781982.604487:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037312 00000100:00100000:0.0:1787781982.604490:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037312 00000100:00100000:0.0:1787781982.604508:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036672 00000100:00100000:0.0:1787781982.604510:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036672 00000100:00100000:0.0:1787781982.604520:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037184 00000100:00100000:0.0:1787781982.604534:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037184 00000100:00100000:0.0:1787781982.604552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 316 00000100:00100000:0.0:1787781982.604558:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943036800:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604589:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943036800:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604596:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 316 00000100:00100000:0.0:1787781982.604644:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 317 00000100:00100000:0.0:1787781982.604651:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943037312:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604678:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943037312:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604684:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 317 00000100:00100000:0.0:1787781982.604696:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 318 00000100:00100000:0.0:1787781982.604703:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2406:x1874624943036672:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604750:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2406:x1874624943036672:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 47us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604762:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 318 00000100:00100000:0.0:1787781982.604774:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 319 00000100:00100000:0.0:1787781982.604781:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2406:x1874624943037184:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781982.604807:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2406:x1874624943037184:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781982.604814:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 319 00000100:00080000:0.0:1787781982.604830:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781982.605186:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943036544 00000100:00100000:3.0:1787781982.605191:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943036544 00000100:00100000:3.0:1787781982.605234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 385 00000100:00100000:3.0:1787781982.605243:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943036544:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781982.605294:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943036544:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 53us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.605301:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 385 00000100:00100000:1.0:1787781982.726021:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781982.726047:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963033344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781982.726119:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.726376:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033344 00000100:00100000:3.0:1787781982.726385:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033344 00000100:00100000:3.0:1787781982.726440:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787781982.726450:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963033344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781982.726483:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787781982.726879:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963033344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 430us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.726887:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787781982.727027:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963033344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781982.735407:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963033472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781982.735493:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781982.735804:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033472 00000100:00100000:2.0:1787781982.735814:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033472 00000100:00100000:2.0:1787781982.735867:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787781982.735877:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963033472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781982.735918:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787781982.735969:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963033472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781982.735990:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787781982.736036:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963033472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781983.302146:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781984.326132:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781984.773970:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781984.773992:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963033600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787781984.774064:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781984.774185:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033600 00000100:00100000:2.0:1787781984.774192:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033600 00000100:00100000:2.0:1787781984.774245:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787781984.774254:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963033600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787781984.774287:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787781984.774362:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963033600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781984.774370:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787781984.774499:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963033600:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787781984.777098:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787781984.777113:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787781984.777191:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787781984.777203:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787781985.349743:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787781985.748408:0:14574:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:06:23 (1787781983) 00010000:00010000:3.0:1787781986.374294:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781986.822848:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963033728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781986.822927:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823067:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033728 00000100:00100000:3.0:1787781986.823077:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033728 00000100:00100000:3.0:1787781986.823125:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787781986.823134:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963033728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781986.823170:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787781986.823232:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963033728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781986.823239:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787781986.823353:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963033728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781986.823691:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963033984:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.823733:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823792:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963034496:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.823815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823834:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963035008:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.823860:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823881:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787781986.823887:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963034112:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.823907:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823923:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963034624:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.823961:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.823980:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963035136:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.824003:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781986.824031:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033984 00000100:00100000:3.0:1787781986.824035:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033984 00000100:00100000:3.0:1787781986.824061:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034496 00000100:00100000:3.0:1787781986.824065:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034496 00000100:00100000:3.0:1787781986.824088:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035008 00000100:00100000:3.0:1787781986.824091:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035008 00000100:00100000:3.0:1787781986.824101:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034112 00000100:00100000:3.0:1787781986.824103:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034112 00000100:00100000:3.0:1787781986.824188:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787781986.824196:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963033984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.824289:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963033984:12345-0@lo:400:kworker.0 Request processed in 94us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781986.824296:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787781986.824311:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787781986.824317:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963034496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.824347:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963034496:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781986.824360:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787781986.824373:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787781986.824379:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963035008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.824446:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963034240:0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.824500:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963033856:0@lo:400:kworker.0 00000100:00100000:1.0:1787781986.824551:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787781986.824560:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.824597:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963035008:12345-0@lo:400:kworker.0 Request processed in 219us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781986.824603:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787781986.825174:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781986.825213:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963034752:0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825240:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781986.825258:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963035264:0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825279:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781986.825320:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034624 00000100:00100000:2.0:1787781986.825326:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034624 00000100:00100000:2.0:1787781986.825359:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035136 00000100:00100000:2.0:1787781986.825362:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035136 00000100:00100000:2.0:1787781986.825375:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034752 00000100:00100000:2.0:1787781986.825386:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034752 00000100:00100000:2.0:1787781986.825404:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035264 00000100:00100000:2.0:1787781986.825407:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035264 00000100:00100000:2.0:1787781986.825419:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787781986.825425:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c445221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963034624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825462:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c445221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963034624:12345-0@lo:400:kworker.0 Request processed in 37us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.825468:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787781986.825482:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787781986.825488:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44522940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963035136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825522:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44522940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963035136:12345-0@lo:400:kworker.0 Request processed in 35us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.825528:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787781986.825540:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787781986.825545:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963034752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825575:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963034752:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.825581:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787781986.825592:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787781986.825597:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963035264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.825639:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963035264:12345-0@lo:400:kworker.0 Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.825645:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787781986.826588:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963034752:0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.826605:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963035264:0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.826727:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034240 00000100:00100000:2.0:1787781986.826733:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034240 00000100:00100000:2.0:1787781986.826775:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787781986.826781:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.826848:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963034240:12345-0@lo:400:kworker.0 Request processed in 67us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.826854:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787781986.826896:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963034240:0@lo:400:kworker.0 00000100:00080000:2.0:1787781986.826958:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781986.826963:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781986.826966:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781986.827232:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781986.827275:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963034368:0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.827303:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781986.827324:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963034880:0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.827345:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781986.828132:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034368 00000100:00100000:0.0:1787781986.828139:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034368 00000100:00100000:0.0:1787781986.828184:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963034880 00000100:00100000:0.0:1787781986.828187:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963034880 00000100:00100000:0.0:1787781986.828203:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787781986.828211:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963034368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.828260:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963034368:12345-0@lo:400:kworker.0 Request processed in 51us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781986.828267:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787781986.828294:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787781986.828300:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963034880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.828330:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963034880:12345-0@lo:400:kworker.0 Request processed in 31us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781986.828336:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:0.0:1787781986.828352:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781986.828378:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963034368:0@lo:400:kworker.0 00000100:00100000:0.0:1787781986.828388:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963034880:0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.829020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963033856 00000100:00100000:2.0:1787781986.829027:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963033856 00000100:00100000:2.0:1787781986.829071:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787781986.829079:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963033856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781986.829125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963033856:12345-0@lo:400:kworker.0 Request processed in 48us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.829132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787781986.829225:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963033856:0@lo:400:kworker.0 00000100:00100000:1.0:1787781986.829631:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963034112:12345-0@lo:400:kworker.0 Request processed in 5070us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781986.829639:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787781986.830126:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963033984:0@lo:400:kworker.0 00010000:00080000:3.0:1787781986.830143:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fd92c0 x1874624963034496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781986.830154:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963034496:0@lo:400:kworker.0 00010000:00080000:3.0:1787781986.830252:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fd8f00 x1874624963035008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781986.830265:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963035008:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.830295:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963034112:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.830307:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963034624:0@lo:400:kworker.0 00000100:00100000:3.0:1787781986.830318:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963035136:0@lo:400:kworker.0 00000100:00100000:0.0:1787781987.161544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781987.161639:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037568 00000100:00100000:2.0:1787781987.161649:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037568 00000100:00100000:2.0:1787781987.161733:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:2.0:1787781987.161745:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:12198:x1874624943037568:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781987.161767:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781987.161787:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063d28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b7d expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161856:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161883:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161897:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161913:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161920:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.161927:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162026:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063d3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162035:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063d3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162042:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063d3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781987.162051:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787781987.162126:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162134:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162141:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162153:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781987.162157:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162165:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162176:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:2.0:1787781987.162179:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781987.162184:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162190:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063d2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162204:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162210:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162216:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162220:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781987.162222:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162228:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162245:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff993c436a3e00) 00010000:00010000:2.0:1787781987.162247:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781987.162250:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.162255:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063d36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781987.163124:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781987.164758:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063d28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b7d expref: 16 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.164786:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063d3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b7d expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781987.164795:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:2.0:1787781987.164798:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781987.164802:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781987.164882:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:12198:x1874624943037568:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 3139us (3346us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787781987.164891:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 150 00000100:00100000:2.0:1787781987.174541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781987.174662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781987.174750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037696 00000100:00100000:1.0:1787781987.174759:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037696 00000100:00100000:1.0:1787781987.174824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:1.0:1787781987.174833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:2409:x1874624943037696:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781987.174849:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781987.174874:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c15063d3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b7d expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781987.174892:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:1.0:1787781987.174898:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781987.174964:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2409:x1874624943037696:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 131us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781987.174971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:0.0:1787781987.175226:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037824 00000100:00100000:0.0:1787781987.175231:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037824 00000100:00100000:0.0:1787781987.175271:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00100000:0.0:1787781987.175279:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:12198:x1874624943037824:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787781987.175345:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:12198:x1874624943037824:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 67us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.175352:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 151 00000100:00100000:0.0:1787781987.186400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781987.186499:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943037952 00000100:00100000:1.0:1787781987.186508:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943037952 00000100:00100000:1.0:1787781987.186589:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 152 00000100:00100000:1.0:1787781987.186599:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:12198:x1874624943037952:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787781987.186729:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:12198:x1874624943037952:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 131us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781987.186735:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 152 00000100:00080000:0.0:1787781987.187186:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781987.334002:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963035392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781987.334098:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781987.334245:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035392 00000100:00100000:1.0:1787781987.334255:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035392 00000100:00100000:1.0:1787781987.334319:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787781987.334331:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963035392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781987.334375:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787781987.334430:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963035392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781987.334438:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781987.334705:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963035392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781987.334909:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963035520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781987.334956:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.335053:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035520 00000100:00100000:2.0:1787781987.335058:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035520 00000100:00100000:2.0:1787781987.335098:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787781987.335116:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963035520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787781987.335132:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787781987.335182:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963035520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.335189:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787781987.335444:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963035520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787781987.403597:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781987.463486:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787781987.720187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781987.720384:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038592 00000100:00100000:3.0:1787781987.720395:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038592 00000100:00100000:0.0:1787781987.720565:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038080 00000100:00100000:0.0:1787781987.720570:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038080 00000100:00100000:0.0:1787781987.720633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 387 00000100:00100000:0.0:1787781987.720645:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943038080:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.720734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943038080:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 91us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.720767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 387 00000100:00100000:0.0:1787781987.720807:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038336 00000100:00100000:0.0:1787781987.720811:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038336 00000100:00100000:0.0:1787781987.720833:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038848 00000100:00100000:0.0:1787781987.720836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038848 00000100:00100000:0.0:1787781987.720851:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038208 00000100:00100000:0.0:1787781987.720853:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038208 00000100:00100000:0.0:1787781987.720881:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038720 00000100:00100000:0.0:1787781987.720884:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038720 00000100:00100000:0.0:1787781987.720902:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 326 00000100:00100000:0.0:1787781987.720908:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c445203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943038336:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.720940:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c445203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943038336:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 33us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.720958:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 326 00000100:00100000:0.0:1787781987.720971:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 327 00000100:00100000:0.0:1787781987.720977:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943038848:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.721002:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943038848:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.721008:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 327 00000100:00100000:0.0:1787781987.721020:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 328 00000100:00100000:0.0:1787781987.721026:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2408:x1874624943038208:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.721051:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2408:x1874624943038208:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.721057:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 328 00000100:00100000:0.0:1787781987.721068:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 329 00000100:00100000:0.0:1787781987.721081:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2408:x1874624943038720:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.721106:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2408:x1874624943038720:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.721113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 329 00000100:00080000:0.0:1787781987.721131:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781987.721135:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787781987.721138:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781987.721378:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038464 00000100:00100000:3.0:1787781987.721383:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038464 00000100:00100000:0.0:1787781987.724068:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 156 00000100:00100000:0.0:1787781987.724098:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943038592:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.724216:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943038592:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 134us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.724226:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 156 00000100:00100000:0.0:1787781987.724255:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 157 00000100:00100000:0.0:1787781987.724263:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943038464:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781987.724288:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943038464:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781987.724295:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 157 00000100:00080000:0.0:1787781987.724359:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781987.845863:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963035648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781987.845976:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.846132:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035648 00000100:00100000:2.0:1787781987.846142:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035648 00000100:00100000:2.0:1787781987.846206:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787781987.846218:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963035648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781987.846253:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787781987.846315:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963035648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.846323:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787781987.846407:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963035648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781987.848178:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963035776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781987.848249:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781987.848376:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963035776 00000100:00100000:3.0:1787781987.848384:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963035776 00000100:00100000:3.0:1787781987.848443:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787781987.848454:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963035776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781987.848490:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787781987.848672:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963035776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781987.848680:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787781987.848776:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963035776:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787781988.101857:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781988.101869:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781988.102012:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787781988.102022:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787781988.422109:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781988.486330:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787781989.400563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.402518:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943038976 00000100:00100000:0.0:1787781989.402549:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943038976 00000100:00100000:0.0:1787781989.402671:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 153 00000100:00100000:0.0:1787781989.402687:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:12241:x1874624943038976:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781989.402712:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781989.402739:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b84 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402818:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402836:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402851:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402867:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402874:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402881:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402944:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402952:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402959:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402974:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781989.402979:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.402989:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403004:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781989.403008:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781989.403014:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403021:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403036:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403043:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403049:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403054:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781989.403057:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403062:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403083:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff993d679e1300) 00010000:00010000:0.0:1787781989.403086:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781989.403089:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403095:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403136:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b84 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403147:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781989.403150:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781989.403153:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b84 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.403163:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:0.0:1787781989.403246:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:12241:x1874624943038976:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 564us (2697us total) trans 0 rc 301/301 00000100:00100000:0.0:1787781989.403254:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 153 00000100:00080000:1.0:1787781989.404672:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781989.414204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.414335:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943039232 00000100:00100000:0.0:1787781989.414348:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943039232 00000100:00100000:0.0:1787781989.414478:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 154 00000100:00100000:0.0:1787781989.414489:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:12241:x1874624943039232:12345-192.168.206.16@tcp:36:lfs.0 00010000:00010000:0.0:1787781989.414565:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781989.414598:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c1506369f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839a8 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.414659:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781989.414665:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781989.414739:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.414756:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 5 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.414767:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.414809:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 5 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.414825:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 5 pid: 6531 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781989.414842:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963035904:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781989.414975:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d5069b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781989.419882:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963035904:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781989.419921:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781989.436136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.436219:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943039360 00000100:00100000:1.0:1787781989.436231:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943039360 00010000:00010000:1.0:1787781989.436304:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 6 pid: 6531 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781989.436347:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781989.436348:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 79 00000100:00100000:1.0:1787781989.436361:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2409:x1874624943039360:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781989.436378:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781989.436385:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 6 pid: 6531 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436412:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 6 pid: 6531 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436438:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063d21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b76 expref: 6 pid: 6531 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436458:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:1.0:1787781989.436464:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436475:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436484:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.436522:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781989.436590:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2409:x1874624943039360:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 230us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.436598:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 79 00010000:00010000:0.0:1787781989.437252:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.437264:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.437296:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.437318:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.437329:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438029:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438107:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438116:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781989.438212:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000863d7e1e reply state 00000000078fd54b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438228:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438236:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781989.438240:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781989.438243:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787781989.438251:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787781989.438260:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438268:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438275:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438290:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781989.438295:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438304:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438318:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d679e2100) 00010000:00010000:0.0:1787781989.438321:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781989.438325:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438332:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063d60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781989.438349:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000863d7e1e reply state 00000000078fd54b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438357:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.438363:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff993d679e1300) 00010000:00010000:0.0:1787781989.438366:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781989.438368:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787781989.438477:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:12241:x1874624943039232:12345-192.168.206.16@tcp:36:lfs.0 Request processed in 23986us (24286us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787781989.438486:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 154 00010000:00010000:3.0:1787781989.448159:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781989.545875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.545928:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943039488 00000100:00100000:3.0:1787781989.545952:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943039488 00000100:00100000:3.0:1787781989.546021:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 155 00000100:00100000:3.0:1787781989.546032:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+15:12249:x1874624943039488:12345-192.168.206.16@tcp:101:lctl.0 00010000:00010000:3.0:1787781989.546066:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.546095:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063d75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b8b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546174:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546192:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546205:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781989.546256:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787781989.546261:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781989.546287:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546315:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063d75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b8b expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546337:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b8b expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.546346:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:3.0:1787781989.546361:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781989.546366:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705c00, rc 0) 00000100:00100000:3.0:1787781989.546433:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:12249:x1874624943039488:12345-192.168.206.16@tcp:101:lctl.0 Request processed in 403us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781989.550592:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 155 00000100:00100000:2.0:1787781989.614094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.614442:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943039616 00000100:00100000:1.0:1787781989.614454:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943039616 00000100:00100000:1.0:1787781989.614537:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 156 00000100:00100000:1.0:1787781989.614549:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+16:12255:x1874624943039616:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781989.614576:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781989.614660:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063d83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b92 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614772:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614789:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614801:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614813:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614821:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614828:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614927:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614948:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.614955:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781989.614998:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787781989.615002:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781989.615028:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615176:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615240:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615249:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615256:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbe00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781989.615261:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615270:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615285:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:1.0:1787781989.615289:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781989.615294:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615300:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15063d8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615315:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615322:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615328:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615340:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781989.615344:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615350:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615358:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff993d679e1300) 00010000:00010000:1.0:1787781989.615361:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781989.615364:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615370:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063d91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615400:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c15063d83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b92 expref: 18 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615414:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b92 expref: 17 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.615422:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781989.615425:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787781989.615427:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb600, rc 0) 00000100:00100000:1.0:1787781989.615567:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:12255:x1874624943039616:12345-192.168.206.16@tcp:101:bash.0 Request processed in 1020us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.615576:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 156 00000100:00100000:2.0:1787781989.624275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.624784:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943039872 00000100:00100000:0.0:1787781989.624797:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943039872 00000100:00100000:0.0:1787781989.625217:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 157 00000100:00100000:0.0:1787781989.625243:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:12255:x1874624943039872:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781989.625266:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781989.625289:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83b99 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627031:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627055:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627068:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627084:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627091:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.627097:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781989.629261:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787781989.629454:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629472:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629484:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629538:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629546:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629553:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629559:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781989.629564:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629573:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629587:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781989.629590:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781989.629596:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629603:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063da6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781989.629642:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8355f88 reply state 00000000497491f2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629652:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.629658:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:0.0:1787781989.629667:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787781989.629671:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787781989.631140:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063d9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.631176:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.631187:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:0.0:1787781989.631190:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781989.631194:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9800, rc 0) 00000100:00100000:0.0:1787781989.631276:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:12255:x1874624943039872:12345-192.168.206.16@tcp:101:bash.0 Request processed in 6035us (7016us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787781989.631290:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 157 00000100:00100000:2.0:1787781989.636757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.636902:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943040000 00000100:00100000:1.0:1787781989.636931:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943040000 00000100:00100000:1.0:1787781989.637049:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787781989.637062:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943040000:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781989.637087:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781989.637124:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ba0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781989.637156:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787781989.637180:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1787781989.637334:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781989.637349:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.637379:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.637397:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa400, rc 0) 00000100:00100000:1.0:1787781989.637602:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943040000:12345-192.168.206.16@tcp:101:bash.0 Request processed in 541us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.637648:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00080000:0.0:1787781989.639314:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781989.643178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.643309:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943040128 00000100:00100000:0.0:1787781989.643322:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943040128 00000100:00100000:0.0:1787781989.643399:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:0.0:1787781989.643410:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:12255:x1874624943040128:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781989.643435:0:13830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781989.643453:0:13830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ba7 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.643485:0:13830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.643493:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781989.643497:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781989.643529:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 7 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.643567:0:13830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.643583:0:13830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781989.643598:0:13830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13830:1874624963036032:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781989.643839:0:13830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781989.648701:0:13830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13830:1874624963036032:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781989.648749:0:13830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 7 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.648776:0:13830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9e00, rc 0) 00000100:00100000:1.0:1787781989.648875:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:12255:x1874624943040128:12345-192.168.206.16@tcp:101:bash.0 Request processed in 5465us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.648886:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:2.0:1787781989.654770:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.655203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943040256 00000100:00100000:1.0:1787781989.655214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943040256 00010000:00010000:1.0:1787781989.655260:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781989.655346:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 80 00000100:00100000:1.0:1787781989.655355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943040256:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781989.655371:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781989.655392:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.655407:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.655437:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e53f79c4/0xc6d6745c15063dc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba0 expref: 7 pid: 8446 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.655453:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781989.655458:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781989.655466:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.655477:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.655543:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781989.655558:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6517:1874624963036160:192.168.206.16@tcp:105: 00000100:00100000:1.0:1787781989.655683:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781989.662593:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6517:1874624963036160:192.168.206.16@tcp:105: 00010000:00010000:1.0:1787781989.662653:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781989.662716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2409:x1874624943040256:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 7361us (7954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.662727:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 80 00000100:00100000:2.0:1787781989.662930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.663192:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943040512 00000100:00100000:0.0:1787781989.663199:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943040512 00000100:00100000:0.0:1787781989.663246:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:0.0:1787781989.663254:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:12255:x1874624943040512:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:0.0:1787781989.663779:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12255:x1874624943040512:12345-192.168.206.16@tcp:35:bash.0 Request processed in 523us (1312us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787781989.663787:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:0.0:1787781989.767446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.767578:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943040768 00000100:00100000:3.0:1787781989.767588:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943040768 00000100:00100000:3.0:1787781989.767682:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 158 00000100:00100000:3.0:1787781989.767692:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12265:x1874624943040768:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781989.767714:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.767733:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bae expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781989.767825:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787781989.767923:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063dd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bae expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.767948:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:3.0:1787781989.767951:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781989.767956:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bae expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.767970:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704600, rc 0) 00000100:00100000:3.0:1787781989.768030:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12265:x1874624943040768:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 340us (592us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1787781989.768038:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 158 00000100:00100000:0.0:1787781989.778987:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781989.779093:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041024 00000100:00100000:2.0:1787781989.779102:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041024 00000100:00100000:2.0:1787781989.779160:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:2.0:1787781989.779171:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12265:x1874624943041024:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781989.779411:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12265:x1874624943041024:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 241us (432us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787781989.779420:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:2.0:1787781989.888032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.891264:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041152 00000100:00100000:3.0:1787781989.891297:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041152 00000100:00100000:0.0:1787781989.891432:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 159 00000100:00100000:0.0:1787781989.891446:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12271:x1874624943041152:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781989.891470:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781989.891495:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bb5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891561:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891581:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891593:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781989.891655:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787781989.891659:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781989.891677:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891701:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bb5 expref: 25 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891719:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bb5 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.891727:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781989.891730:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781989.891734:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9400, rc 0) 00000100:00100000:0.0:1787781989.891863:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12271:x1874624943041152:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 420us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781989.891870:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 159 00000100:00100000:0.0:1787781989.895488:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781989.895524:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963036288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781989.895596:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781989.895917:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963036288 00000100:00100000:3.0:1787781989.895924:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963036288 00000100:00100000:3.0:1787781989.895986:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787781989.895995:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963036288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787781989.896027:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787781989.896081:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963036288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781989.896088:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787781989.897547:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963036288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787781989.904307:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.904459:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041408 00000100:00100000:3.0:1787781989.904470:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041408 00000100:00100000:3.0:1787781989.904545:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 160 00000100:00100000:3.0:1787781989.904554:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12271:x1874624943041408:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781989.904578:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.904601:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063dec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bbc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.904751:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.904767:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.904780:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781989.904791:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787781989.904915:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063dec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bbc expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.904962:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bbc expref: 26 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.904971:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:3.0:1787781989.904974:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781989.904978:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704c00, rc 0) 00000100:00100000:3.0:1787781989.905048:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+26:12271:x1874624943041408:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 495us (754us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787781989.905056:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 160 00000100:00100000:2.0:1787781989.908788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781989.908949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.911222:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041792 00000100:00100000:3.0:1787781989.911242:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041792 00000100:00100000:3.0:1787781989.911335:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:3.0:1787781989.911349:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+26:12271:x1874624943041792:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781989.911391:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.911417:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bc3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.911545:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.911563:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.911577:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781989.911591:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787781989.911762:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bc3 expref: 29 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.911783:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bc3 expref: 28 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.911792:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:3.0:1787781989.911795:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787781989.911799:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705a00, rc 0) 00000100:00100000:3.0:1787781989.911878:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:12271:x1874624943041792:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 533us (2927us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1787781989.911887:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:0.0:1787781989.916401:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041536 00000100:00100000:0.0:1787781989.916421:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041536 00000100:00100000:0.0:1787781989.916519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:0.0:1787781989.916531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:2406:x1874624943041536:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781989.916552:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781989.916584:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c15063df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bbc expref: 28 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.916636:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:0.0:1787781989.916642:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781989.916785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:2406:x1874624943041536:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 255us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781989.916794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:2.0:1787781989.929394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.929905:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943041920 00000100:00100000:3.0:1787781989.929919:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943041920 00000100:00100000:3.0:1787781989.930001:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:3.0:1787781989.930012:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2408:x1874624943041920:12345-192.168.206.16@tcp:1:lfs.0 00010000:00010000:3.0:1787781989.930074:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.930107:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.930117:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787781989.930283:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781989.930290:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.930335:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.930367:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 6 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781989.930385:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1874624963036416:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781989.930514:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781989.935398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.935516:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042048 00000100:00100000:1.0:1787781989.935528:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042048 00002000:00100000:1.0:1787781989.935587:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff993d799b5e00 x1874624943042048/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:135/0 lens 504/0 e 0 to 0 dl 1787782000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781989.935600:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d799b5e00 with x1874624943042048 ext(0->12) 00010000:00010000:1.0:1787781989.935652:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 7 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.935672:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 7 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781989.935680:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d799b5e00 00000100:00100000:1.0:1787781989.935716:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:1.0:1787781989.935727:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943042048:12345-192.168.206.16@tcp:4:lfs.0 00000100:00100000:3.0:1787781989.936635:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c44521680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1874624963036416:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781989.936667:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781989.937511:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943042048:12345-192.168.206.16@tcp:4:lfs.0 Request processed in 1778us (2118us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787781989.937525:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00002000:00100000:1.0:1787781989.937538:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff993d799b5e00 x1874624943042048/t4294967306(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:135/0 lens 504/448 e 0 to 0 dl 1787782000 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781989.937549:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d799b5e00 with x1874624943042048 ext(0->12) 00010000:00010000:1.0:1787781989.937559:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.937576:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781989.937584:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993d799b5e00 00000100:00100000:0.0:1787781989.940816:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781989.940924:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042176 00000100:00100000:2.0:1787781989.940945:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042176 00010000:00010000:2.0:1787781989.940995:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781989.941242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:2.0:1787781989.941256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2407:x1874624943042176:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781989.941277:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787781989.941300:0:6518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787781989.941304:0:6518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787781989 00002000:00010000:2.0:1787781989.941306:0:6518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787781989 00002000:00010000:2.0:1787781989.941308:0:6518:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787781989 00002000:00010000:2.0:1787781989.941311:0:6518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787781989.941318:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781989.941335:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781989.941399:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006637260/0xc6d6745c15063dc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ba7 expref: 9 pid: 13830 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781989.941421:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781989.941425:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781989.941432:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781989.941443:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781989.941491:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781989.941650:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2407:x1874624943042176:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 355us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781989.941659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 81 00010000:00010000:3.0:1787781989.941725:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941735:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941758:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941766:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941775:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941796:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781989.941800:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941810:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941824:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.941833:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8fc10d/0xc6d6745c15063e16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781989.941884:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943041920:12345-192.168.206.16@tcp:1:lfs.0 Request processed in 11875us (12504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781989.941892:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:0.0:1787781989.946602:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781989.946881:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042432 00000100:00100000:1.0:1787781989.946893:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042432 00000100:00100000:1.0:1787781989.946997:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:1.0:1787781989.947009:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12271:x1874624943042432:12345-192.168.206.16@tcp:35:lfs.0 00000004:00010000:1.0:1787781989.947113:0:14286:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bc3 expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781989.947976:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787781989.948013:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787781989.948828:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787781989.948883:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.948906:0:14286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.948927:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.949294:0:14286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.949316:0:14286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 31 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781989.949334:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14286:1874624963036544:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781989.949756:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781989.962389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.962561:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14286:1874624963036544:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781989.962597:0:14286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781989.963080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042560 00000100:00100000:3.0:1787781989.963239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042560 00010000:00010000:3.0:1787781989.963289:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 32 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781989.963378:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 82 00000100:00100000:3.0:1787781989.963389:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:2409:x1874624943042560:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781989.963408:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781989.963415:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 32 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963445:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 32 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963472:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063db4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b99 expref: 32 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963502:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:3.0:1787781989.963508:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963518:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963528:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.963604:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781989.963718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+31:2409:x1874624943042560:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 330us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781989.963726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 82 00010000:00010000:0.0:1787781989.963938:0:14286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781989.963948:0:14286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781989.964082:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1787781989.964322:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787781989.964414:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963036672:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787781989.964542:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781989.964632:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787781989.965876:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963036672 00000100:00100000:2.0:1787781989.965888:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963036672 00000100:00100000:2.0:1787781989.965995:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787781989.966006:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14286:x1874624963036672:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787781989.966157:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14286:x1874624963036672:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 152us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781989.966165:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787781989.966313:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963036672:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787781989.966478:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1787781989.966565:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963036800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787781989.966602:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781989.966654:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781989.966769:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963036800 00000100:00100000:2.0:1787781989.966774:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963036800 00000100:00100000:2.0:1787781989.966813:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787781989.966821:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14286:x1874624963036800:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787781989.966968:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14286:x1874624963036800:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 147us (364us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787781989.966976:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787781989.967248:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963036800:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787781989.967299:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787781989.967340:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967352:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967361:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967376:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781989.967381:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967390:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967408:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:1.0:1787781989.967412:0:14286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787781989.967418:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.967425:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15063e1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781989.967642:0:14286:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787781989.967715:0:14286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787781989.967729:0:14286:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427049120874ns, next at 428049118079ns, rc = 0 00000001:00080000:1.0:1787781989.967736:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787781989.967760:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d679e1f00) 00010000:00010000:1.0:1787781989.967763:0:14286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781989.967771:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15063e08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bc3 expref: 35 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781989.967879:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:12271:x1874624943042432:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 20873us (21291us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787781989.967889:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 38 00000020:00080000:1.0:1787781989.967893:0:14286:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787781989.971316:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781989.972293:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042688 00000100:00100000:3.0:1787781989.972309:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042688 00000100:00100000:3.0:1787781989.972384:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00100000:3.0:1787781989.972396:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:12271:x1874624943042688:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781989.972427:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.972456:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063e24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bca expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.972644:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bca expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.972662:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bca expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.972684:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781989.972687:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781989.972691:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781989.972769:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:12271:x1874624943042688:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 374us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781989.972778:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00080000:0.0:1787781989.975258:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781989.976046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781989.976209:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943042944 00000100:00100000:0.0:1787781989.976221:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943042944 00000100:00100000:0.0:1787781989.976296:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:0.0:1787781989.976308:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:12271:x1874624943042944:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781989.976650:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:12271:x1874624943042944:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 344us (622us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787781989.976659:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:2.0:1787781990.087728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781990.087892:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943043200 00000100:00100000:3.0:1787781990.087904:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943043200 00000100:00100000:3.0:1787781990.088018:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 163 00000100:00100000:3.0:1787781990.088029:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+36:12281:x1874624943043200:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781990.088075:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781990.088110:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bd1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781990.088243:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787781990.088365:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd1 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.088383:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:3.0:1787781990.088386:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781990.088409:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd1 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.088426:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704e00, rc 0) 00000100:00100000:3.0:1787781990.088797:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12281:x1874624943043200:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 768us (1080us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787781990.088806:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 163 00000100:00100000:1.0:1787781990.099446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781990.099604:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943043328 00000100:00100000:3.0:1787781990.100039:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943043328 00000100:00100000:3.0:1787781990.100117:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 164 00000100:00100000:3.0:1787781990.100478:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12281:x1874624943043328:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:3.0:1787781990.100588:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100643:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100659:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100673:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100681:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100688:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100785:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100809:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100818:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781990.100879:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100895:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100902:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100910:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100917:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781990.100922:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100942:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100957:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781990.100961:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781990.100966:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100974:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15063e39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.100998:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101005:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101011:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101017:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781990.101020:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101027:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101036:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:3.0:1787781990.101038:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781990.101042:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101047:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063e40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101058:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101064:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101069:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101080:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781990.101083:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101090:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101108:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781990.101111:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781990.101114:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781990.101128:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063e47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781990.101228:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12281:x1874624943043328:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 755us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781990.107569:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 164 00000100:00100000:2.0:1787781990.107796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781990.110687:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943043584 00000100:00100000:1.0:1787781990.110711:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943043584 00000100:00100000:1.0:1787781990.110806:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:1.0:1787781990.110821:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12281:x1874624943043584:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787781990.111166:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:12281:x1874624943043584:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 347us (3371us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787781990.111175:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:2.0:1787781990.180824:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781990.181253:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943043840 00000100:00100000:0.0:1787781990.181267:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943043840 00000100:00100000:0.0:1787781990.181575:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 165 00000100:00100000:0.0:1787781990.181589:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:12284:x1874624943043840:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781990.181658:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781990.181686:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063e4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bd8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181782:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181799:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181812:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181824:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181848:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181855:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.181999:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182008:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182016:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781990.182027:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787781990.182129:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182137:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182144:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182151:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781990.182156:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182164:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182190:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781990.182194:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781990.182200:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182207:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182223:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182229:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182235:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182240:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781990.182243:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182248:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182256:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:0.0:1787781990.182258:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781990.182261:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182267:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182325:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063e4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 41 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182341:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.182349:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781990.182351:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781990.182354:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9a00, rc 0) 00000100:00100000:0.0:1787781990.182758:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41cda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12284:x1874624943043840:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1171us (1945us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787781990.182768:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 165 00000100:00100000:3.0:1787781990.186792:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781990.187968:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943043968 00000100:00100000:1.0:1787781990.187983:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943043968 00000100:00100000:1.0:1787781990.188064:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 166 00000100:00100000:1.0:1787781990.188076:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12284:x1874624943043968:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:1.0:1787781990.188174:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188195:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188208:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188255:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188263:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188270:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188292:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781990.188297:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188306:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188320:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781990.188324:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781990.188329:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.188336:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15063e71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781990.188440:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12284:x1874624943043968:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 366us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781990.188448:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 166 00000100:00100000:2.0:1787781990.192052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781990.192209:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943044224 00000100:00100000:3.0:1787781990.192221:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943044224 00000100:00100000:3.0:1787781990.192288:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:3.0:1787781990.192299:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12284:x1874624943044224:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:3.0:1787781990.192821:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+41:12284:x1874624943044224:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 521us (780us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787781990.192830:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 41 00010000:00010000:3.0:1787781990.469900:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781990.546800:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781990.548421:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943044480 00000100:00100000:0.0:1787781990.548439:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943044480 00000100:00100000:0.0:1787781990.548535:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00100000:0.0:1787781990.548548:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c44523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+41:12315:x1874624943044480:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:0.0:1787781990.548578:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781990.548647:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bdf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.548785:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.548802:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.548816:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781990.548845:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787781990.548988:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063e78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bdf expref: 44 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.549010:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bdf expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.549020:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781990.549023:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781990.549027:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781990.549135:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c44523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12315:x1874624943044480:12345-192.168.206.16@tcp:101:cat.0 Request processed in 589us (2347us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787781990.549143:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00100000:0.0:1787781990.556736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781990.556791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781990.557159:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943044864 00000100:00100000:1.0:1787781990.557172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943044864 00000100:00100000:0.0:1787781990.557434:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787781990.557449:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:2409:x1874624943044864:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781990.557470:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781990.557516:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063e7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bdf expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.557539:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781990.557546:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781990.557652:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:2409:x1874624943044864:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 208us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781990.557679:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:2.0:1787781990.559645:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943044736 00000100:00100000:2.0:1787781990.559665:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943044736 00000100:00100000:2.0:1787781990.559750:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:2.0:1787781990.559762:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:12315:x1874624943044736:12345-192.168.206.16@tcp:35:cat.0 00000100:00100000:2.0:1787781990.560810:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12315:x1874624943044736:12345-192.168.206.16@tcp:35:cat.0 Request processed in 1043us (4079us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787781990.560823:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:0.0:1787781990.646335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781990.646567:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943045120 00000100:00100000:1.0:1787781990.646580:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943045120 00000100:00100000:1.0:1787781990.646687:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 168 00000100:00100000:1.0:1787781990.646699:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12321:x1874624943045120:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:1.0:1787781990.646728:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781990.646732:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787781990.646766:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bb5 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.646810:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781990.646816:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781990.646833:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063e8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83be6 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.646980:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.646994:0:10060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.647002:0:10060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.647039:0:10060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.647053:0:10060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 43 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781990.647067:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963036928:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781990.647758:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781990.655076:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781990.655185:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943045248 00000100:00100000:2.0:1787781990.655202:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943045248 00010000:00010000:2.0:1787781990.655276:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 44 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781990.655330:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 83 00000100:00100000:2.0:1787781990.655342:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:2408:x1874624943045248:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781990.655360:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781990.655369:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 44 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.655385:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 44 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.655429:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781990.655436:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.655461:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.655471:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.655496:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781990.655575:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:2408:x1874624943045248:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 235us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781990.655583:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 83 00010000:00010000:1.0:1787781990.655940:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063e63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bd8 expref: 43 pid: 6533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781990.655965:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963036928:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781990.656011:0:10060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.656021:0:10060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.656027:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781990.656049:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787781990.656258:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063e8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 44 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.656275:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 43 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.656284:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781990.656286:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787781990.656290:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa000, rc 0) 00000100:00100000:1.0:1787781990.656336:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12321:x1874624943045120:12345-192.168.206.16@tcp:101:dd.0 Request processed in 9639us (10014us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787781990.656345:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 168 00000100:00100000:3.0:1787781990.660229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781990.660339:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943045376 00000100:00100000:0.0:1787781990.660348:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943045376 00000100:00100000:0.0:1787781990.660420:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 169 00000100:00100000:0.0:1787781990.660429:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41324f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12321:x1874624943045376:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:0.0:1787781990.660452:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781990.660474:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063ea2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bed expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660710:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660724:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660734:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660853:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063ea2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 45 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660872:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 44 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.660880:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781990.660883:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781990.660887:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787781990.660956:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41324f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:12321:x1874624943045376:12345-192.168.206.16@tcp:101:dd.0 Request processed in 528us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781990.660964:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 169 00000100:00100000:0.0:1787781990.667556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781990.669219:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943045632 00000100:00100000:2.0:1787781990.669233:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943045632 00000100:00100000:2.0:1787781990.669327:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 170 00000100:00100000:2.0:1787781990.669337:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:12321:x1874624943045632:12345-192.168.206.16@tcp:36:dd.0 00010000:00010000:2.0:1787781990.669531:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.669547:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.669558:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781990.669594:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787781990.669639:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c21e17e5 reply state 0000000053522a6b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.669666:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.669673:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781990.669676:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781990.669679:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781990.669785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:12321:x1874624943045632:12345-192.168.206.16@tcp:36:dd.0 Request processed in 449us (2237us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787781990.669792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 170 00000020:00080000:2.0:1787781990.669797:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787781990.925286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781990.925439:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943045760 00000100:00100000:1.0:1787781990.925449:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943045760 00000100:00100000:1.0:1787781990.925520:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 171 00000100:00100000:1.0:1787781990.925531:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:12335:x1874624943045760:12345-192.168.206.16@tcp:101:stat.0 00010000:00010000:1.0:1787781990.925555:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781990.925576:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063eb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bf4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925702:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925717:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925731:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925756:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925763:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925770:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925838:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925850:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925857:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925891:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781990.925915:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 48 pid: 10060 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781990.925939:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963037056:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781990.926047:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781990.931322:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963037056:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781990.931353:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781990.932298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781990.932943:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943046016 00000100:00100000:2.0:1787781990.932953:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943046016 00000100:00100000:2.0:1787781990.933059:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:2.0:1787781990.933071:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:6189:x1874624943046016:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787781990.933392:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:6189:x1874624943046016:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 322us (1096us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787781990.933400:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:3.0:1787781990.935725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781990.936073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943046144 00000100:00100000:0.0:1787781990.936083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943046144 00010000:00010000:0.0:1787781990.936135:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 50 pid: 10060 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781990.936173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 84 00000100:00100000:0.0:1787781990.936182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:2409:x1874624943046144:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781990.936197:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781990.936204:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 50 pid: 10060 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936217:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 50 pid: 10060 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936241:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15063e94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83be6 expref: 50 pid: 10060 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781990.936262:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936272:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936280:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781990.936332:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781990.936389:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+49:2409:x1874624943046144:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 207us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781990.936408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 84 00010000:00010000:2.0:1787781990.937761:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937774:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781990.937830:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781990.937835:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781990.937862:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937877:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937901:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937907:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937915:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937920:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfac00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781990.937924:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937942:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937956:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781990.937959:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781990.937963:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937970:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c15063ebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937986:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937992:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.937997:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938009:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781990.938012:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938018:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938027:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:2.0:1787781990.938030:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781990.938033:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938039:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15063ec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938075:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15063eb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bf4 expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938104:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bf4 expref: 48 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781990.938111:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781990.938114:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781990.938116:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:2.0:1787781990.938230:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+48:12335:x1874624943045760:12345-192.168.206.16@tcp:101:stat.0 Request processed in 12700us (12953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781990.938239:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 171 00000100:00100000:3.0:1787781991.018173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.018281:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943046400 00000100:00100000:1.0:1787781991.018291:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943046400 00000100:00100000:1.0:1787781991.018382:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 172 00000100:00100000:1.0:1787781991.018394:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+48:12341:x1874624943046400:12345-192.168.206.16@tcp:36:truncate.0 00010000:00010000:1.0:1787781991.018449:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781991.018478:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15063ecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bf4 expref: 48 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.018506:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.018511:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781991.018705:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.018719:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.018729:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781991.018786:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1787781991.018808:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f118604 reply state 0000000080b43d1a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.018820:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.018827:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.018829:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787781991.018831:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781991.018920:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:12341:x1874624943046400:12345-192.168.206.16@tcp:36:truncate.0 Request processed in 529us (754us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787781991.018939:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 172 00000020:00080000:1.0:1787781991.018944:0:10060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1787781991.019317:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781991.247223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.247695:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943046528 00000100:00100000:0.0:1787781991.247707:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943046528 00000100:00100000:0.0:1787781991.247773:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 173 00000100:00100000:0.0:1787781991.247783:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+50:12355:x1874624943046528:12345-192.168.206.16@tcp:101:stat.0 00010000:00010000:0.0:1787781991.247809:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781991.247830:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063eda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83bfb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247918:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247943:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247955:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247966:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247983:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.247990:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248069:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248079:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248087:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781991.248126:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787781991.248130:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781991.248149:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248161:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248168:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248174:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248181:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248187:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.248191:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248199:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248219:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781991.248222:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781991.248228:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248234:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063ee1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248250:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248256:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248263:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248267:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.248270:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248276:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248283:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:0.0:1787781991.248285:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781991.248288:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248294:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063ee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248331:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063eda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 52 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248345:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 51 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.248352:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781991.248354:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781991.248357:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9a00, rc 0) 00000100:00100000:0.0:1787781991.248436:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:12355:x1874624943046528:12345-192.168.206.16@tcp:101:stat.0 Request processed in 654us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.248444:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 173 00000100:00100000:1.0:1787781991.391826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.391991:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943046784 00000100:00100000:0.0:1787781991.392001:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943046784 00000100:00100000:0.0:1787781991.392068:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 174 00000100:00100000:0.0:1787781991.392078:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:12365:x1874624943046784:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781991.392097:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781991.392117:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c02 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781991.392218:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787781991.392320:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063ef6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c02 expref: 53 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.392334:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:0.0:1787781991.392337:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781991.392357:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c02 expref: 53 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.392371:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9800, rc 0) 00000100:00100000:0.0:1787781991.392943:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:12365:x1874624943046784:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 862us (1129us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1787781991.392952:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 174 00000100:00100000:3.0:1787781991.397391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.397499:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047040 00000100:00100000:1.0:1787781991.397516:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047040 00000100:00100000:1.0:1787781991.397577:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:1.0:1787781991.397588:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:12365:x1874624943047040:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787781991.398151:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:12365:x1874624943047040:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 563us (767us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787781991.398160:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:3.0:1787781991.481717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.481819:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047296 00000100:00100000:0.0:1787781991.481830:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047296 00000100:00100000:0.0:1787781991.481964:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 175 00000100:00100000:0.0:1787781991.481984:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d50323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+53:12371:x1874624943047296:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:0.0:1787781991.482009:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781991.482033:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c09 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.482143:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.482158:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.482168:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.482199:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.482214:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 54 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.482247:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7c4b6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963037184:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781991.482564:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781991.486175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.486305:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7c4b6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963037184:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781991.486335:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.486473:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047424 00000100:00100000:1.0:1787781991.486644:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047424 00010000:00010000:1.0:1787781991.486682:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 55 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.486721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 85 00000100:00100000:1.0:1787781991.486748:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:2408:x1874624943047424:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781991.486764:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781991.486770:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 55 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486783:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 55 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486806:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bfb expref: 55 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486820:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.486824:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486833:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486840:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.486871:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781991.486917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:2408:x1874624943047424:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 169us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.486936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 85 00010000:00010000:3.0:1787781991.487215:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.487224:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781991.487241:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787781991.487361:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 55 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.487376:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.487382:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781991.487385:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781991.487387:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9e00, rc 0) 00000100:00100000:3.0:1787781991.487416:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d50323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:12371:x1874624943047296:12345-192.168.206.16@tcp:101:bash.0 Request processed in 5443us (5707us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787781991.487423:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 175 00000100:00100000:3.0:1787781991.492237:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781991.492570:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047680 00000100:00100000:2.0:1787781991.492580:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047680 00000100:00100000:2.0:1787781991.492670:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 176 00000100:00100000:2.0:1787781991.492681:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:12371:x1874624943047680:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:2.0:1787781991.492911:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.492942:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.492955:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781991.492999:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1787781991.493023:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9487918 reply state 000000006d14c5a2 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.493036:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.493043:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781991.493046:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781991.493049:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787781991.493826:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781991.493888:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:12371:x1874624943047680:12345-192.168.206.16@tcp:36:bash.0 Request processed in 1205us (1656us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787781991.493897:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 176 00000020:00080000:2.0:1787781991.493903:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787781991.505712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781991.505817:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047808 00000100:00100000:2.0:1787781991.505827:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047808 00000100:00100000:2.0:1787781991.505888:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 177 00000100:00100000:2.0:1787781991.505900:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:12371:x1874624943047808:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781991.505950:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781991.505981:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063f20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c10 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.506072:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.506253:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 58 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.506263:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.506299:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 58 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.506312:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 58 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.506326:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963037312:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781991.506419:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781991.511201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.511526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943047936 00000100:00100000:0.0:1787781991.511536:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943047936 00010000:00010000:0.0:1787781991.511577:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 59 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.511650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 86 00000100:00100000:0.0:1787781991.511661:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:2409:x1874624943047936:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781991.511677:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781991.511684:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 59 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.511698:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 59 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.511720:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781991.511726:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.511736:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.511763:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.511782:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781991.511831:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:2409:x1874624943047936:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 172us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.511839:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 86 00010000:00010000:2.0:1787781991.512802:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c09 expref: 58 pid: 6531 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.512823:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963037312:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781991.512849:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.512874:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.512880:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781991.512945:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781991.512950:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781991.513036:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.513072:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c15063f20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c10 expref: 58 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.513088:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c10 expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.513208:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781991.513212:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781991.513215:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4800, rc 0) 00000100:00100000:2.0:1787781991.513276:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:12371:x1874624943047808:12345-192.168.206.16@tcp:101:bash.0 Request processed in 7379us (7573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.513285:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 177 00000100:00100000:1.0:1787781991.521035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781991.521413:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943048192 00000100:00100000:2.0:1787781991.521424:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943048192 00000100:00100000:2.0:1787781991.521722:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:2.0:1787781991.521734:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+57:12371:x1874624943048192:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:2.0:1787781991.521963:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12371:x1874624943048192:12345-192.168.206.16@tcp:35:bash.0 Request processed in 231us (936us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787781991.521988:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:0.0:1787781991.631289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.631412:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943048448 00000100:00100000:1.0:1787781991.631422:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943048448 00000100:00100000:1.0:1787781991.631497:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:1.0:1787781991.631507:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12381:x1874624943048448:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.631531:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.631552:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c17 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.631699:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787781991.631812:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c17 expref: 60 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.631834:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:1.0:1787781991.631837:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781991.631842:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c17 expref: 60 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.631855:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfae00, rc 0) 00000100:00100000:1.0:1787781991.631910:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12381:x1874624943048448:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 405us (630us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787781991.631917:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:3.0:1787781991.638550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.638748:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943048576 00000100:00100000:0.0:1787781991.638758:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943048576 00000100:00100000:0.0:1787781991.638822:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:0.0:1787781991.638832:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12381:x1874624943048576:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:0.0:1787781991.638913:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.638941:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.638953:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.638965:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.638973:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.638980:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639072:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639082:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639104:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781991.639156:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639170:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639178:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639186:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639194:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.639198:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639207:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639219:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781991.639223:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781991.639228:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639241:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063f3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639255:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639261:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639267:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639272:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.639275:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639281:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639289:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:0.0:1787781991.639292:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781991.639295:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639300:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063f43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639309:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639315:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639328:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639334:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.639337:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639344:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639353:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781991.639356:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781991.639359:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.639365:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.639444:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12381:x1874624943048576:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 612us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.639453:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:3.0:1787781991.642358:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.642459:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943048832 00000100:00100000:1.0:1787781991.642480:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943048832 00000100:00100000:1.0:1787781991.642543:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:1.0:1787781991.642554:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12381:x1874624943048832:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787781991.642801:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:12381:x1874624943048832:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 249us (453us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787781991.642828:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:3.0:1787781991.692560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.692750:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049088 00000100:00100000:1.0:1787781991.692761:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049088 00000100:00100000:1.0:1787781991.692834:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 180 00000100:00100000:1.0:1787781991.692845:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:12384:x1874624943049088:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.692870:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.692892:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c1e expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693005:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693019:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693029:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693039:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693046:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693052:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693153:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693175:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693183:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.693194:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787781991.693270:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693278:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693285:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693291:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781991.693295:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693303:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693314:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781991.693317:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.693321:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693328:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15063f58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693340:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693353:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693359:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693364:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781991.693367:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693373:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693382:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:1.0:1787781991.693385:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.693387:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693393:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693430:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c1e expref: 63 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693444:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c1e expref: 62 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.693452:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.693454:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781991.693463:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfaa00, rc 0) 00000100:00100000:1.0:1787781991.693526:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:12384:x1874624943049088:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 682us (974us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787781991.693533:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 180 00000100:00100000:3.0:1787781991.698581:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781991.698716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.698802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049216 00000100:00100000:1.0:1787781991.698812:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049216 00000100:00100000:1.0:1787781991.698883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:1.0:1787781991.698893:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:2408:x1874624943049216:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781991.698909:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781991.698944:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c1e expref: 62 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.698962:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.698966:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781991.699017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:2408:x1874624943049216:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.699025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:0.0:1787781991.704749:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049344 00000100:00100000:0.0:1787781991.704765:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049344 00000100:00100000:0.0:1787781991.704966:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00100000:0.0:1787781991.704977:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:12384:x1874624943049344:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:0.0:1787781991.705047:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705077:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705113:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705149:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705156:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705163:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705168:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781991.705172:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705179:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705190:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781991.705194:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781991.705198:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.705205:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.705283:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:12384:x1874624943049344:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 308us (6710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.705290:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 181 00000100:00100000:3.0:1787781991.714782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781991.720855:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049600 00000100:00100000:2.0:1787781991.720871:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049600 00000100:00100000:2.0:1787781991.720949:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:2.0:1787781991.720960:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:12384:x1874624943049600:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781991.721182:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:12384:x1874624943049600:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 223us (6409us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787781991.721190:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787781991.907044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.907163:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049856 00000100:00100000:1.0:1787781991.907172:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049856 00000100:00100000:1.0:1787781991.907231:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 182 00000100:00100000:1.0:1787781991.907241:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:12402:x1874624943049856:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:1.0:1787781991.907264:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.907286:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c25 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.907398:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.907424:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.907437:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.907450:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787781991.907585:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c25 expref: 65 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.907602:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c25 expref: 64 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.907663:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781991.907666:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787781991.907669:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfae00, rc 0) 00000100:00100000:1.0:1787781991.907742:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+64:12402:x1874624943049856:12345-192.168.206.16@tcp:101:cat.0 Request processed in 503us (707us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787781991.907750:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 182 00000100:00100000:3.0:1787781991.943717:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781991.943745:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963037440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787781991.943830:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944323:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43dd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963037696:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944363:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944383:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963038208:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944403:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944427:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963038720:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944449:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944473:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787781991.944479:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963037824:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944501:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944517:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963038336:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944538:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944556:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963038848:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.944577:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781991.944646:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038336 00000100:00100000:2.0:1787781991.944652:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038336 00000100:00100000:1.0:1787781991.944805:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963037440 00000100:00100000:1.0:1787781991.944810:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963037440 00000100:00100000:1.0:1787781991.944850:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787781991.944859:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963037440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787781991.944894:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787781991.944951:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963037440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.944958:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787781991.945000:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963037696 00000100:00100000:1.0:1787781991.945004:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963037696 00000100:00100000:1.0:1787781991.945023:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038208 00000100:00100000:1.0:1787781991.945025:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038208 00000100:00100000:1.0:1787781991.945038:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038720 00000100:00100000:1.0:1787781991.945040:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038720 00000100:00100000:1.0:1787781991.945052:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963037824 00000100:00100000:1.0:1787781991.945054:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963037824 00000100:00100000:1.0:1787781991.945066:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787781991.945071:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963037696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945192:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42755680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963037696:12345-0@lo:400:kworker.0 Request processed in 120us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.945200:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787781991.945212:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787781991.945218:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963038208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945242:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963038208:12345-0@lo:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.945247:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787781991.945255:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787781991.945260:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963038720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945280:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c427570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963038720:12345-0@lo:400:kworker.0 Request processed in 20us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.945284:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787781991.945292:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787781991.945297:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963037824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945316:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963037824:12345-0@lo:400:kworker.0 Request processed in 19us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.945330:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787781991.945368:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963037568:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945396:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945418:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963038080:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945435:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945448:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963038592:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945466:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945496:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963037440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787781991.945515:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787781991.945521:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963037952:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945545:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945561:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963038464:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945582:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945600:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963038976:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.945642:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781991.945669:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038848 00000100:00100000:1.0:1787781991.945673:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038848 00000100:00100000:2.0:1787781991.945798:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038464 00000100:00100000:2.0:1787781991.945809:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038464 00000100:00100000:2.0:1787781991.945827:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038976 00000100:00100000:2.0:1787781991.945829:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038976 00000100:00100000:2.0:1787781991.945841:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787781991.945847:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.945884:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963038336:12345-0@lo:400:kworker.0 Request processed in 37us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.945891:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787781991.945905:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787781991.945911:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.945957:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963038464:12345-0@lo:400:kworker.0 Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.945963:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787781991.945974:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787781991.945980:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.946006:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963038976:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.946012:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1787781991.946035:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781991.946039:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787781991.946042:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781991.946063:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963037824:0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.946074:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963038336:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.946281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963037568 00000100:00100000:0.0:1787781991.946286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963037568 00000100:00100000:0.0:1787781991.946318:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787781991.946326:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963037568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.946383:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787781991.946391:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781991.946435:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43dd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963037696:0@lo:400:kworker.0 00000100:00100000:3.0:1787781991.947940:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963037952 00000100:00100000:3.0:1787781991.947954:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963037952 00000100:00100000:3.0:1787781991.948007:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787781991.948016:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948496:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963037568:12345-0@lo:400:kworker.0 Request processed in 2168us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.948505:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787781991.948551:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038080 00000100:00100000:0.0:1787781991.948554:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038080 00000100:00080000:0.0:1787781991.948576:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781991.948595:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963038592 00000100:00100000:0.0:1787781991.948597:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963038592 00000100:00080000:0.0:1787781991.948620:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781991.948648:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787781991.948656:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948703:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963038080:12345-0@lo:400:kworker.0 Request processed in 49us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.948710:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787781991.948726:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787781991.948732:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948761:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963038592:12345-0@lo:400:kworker.0 Request processed in 29us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.948767:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787781991.948852:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963038464:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948867:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c42692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963038976:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948876:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963037568:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948905:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963038080:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.948929:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963038592:0@lo:400:kworker.0 00000100:00100000:1.0:1787781991.950403:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963038848:12345-0@lo:400:kworker.0 Request processed in 4006us (5818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.950416:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:2.0:1787781991.950750:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43cabc00 x1874624963038208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781991.950785:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963038208:0@lo:400:kworker.0 00010000:00080000:2.0:1787781991.950802:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ec000 x1874624963038720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781991.950811:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963038720:0@lo:400:kworker.0 00000100:00100000:3.0:1787781991.950907:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963037952:12345-0@lo:400:kworker.0 Request processed in 2890us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.950917:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787781991.951033:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963037952:0@lo:400:kworker.0 00000100:00100000:0.0:1787781991.951255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781991.951342:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943049984 00000100:00100000:1.0:1787781991.951354:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943049984 00000100:00100000:1.0:1787781991.951426:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 183 00000100:00100000:1.0:1787781991.951435:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+64:12403:x1874624943049984:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.951456:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.951544:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c2c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951624:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951797:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951811:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.951854:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787781991.951858:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781991.951876:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951902:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c15063f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c2c expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951919:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c2c expref: 65 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.951937:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781991.951940:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781991.951944:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb200, rc 0) 00000100:00100000:1.0:1787781991.952006:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12403:x1874624943049984:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 572us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.952013:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 183 00000100:00100000:2.0:1787781991.953249:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963038848:0@lo:400:kworker.0 00000100:00100000:3.0:1787781991.962680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.962877:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943050368 00000100:00100000:0.0:1787781991.962886:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943050368 00000100:00100000:0.0:1787781991.962968:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:0.0:1787781991.962978:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12403:x1874624943050368:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:0.0:1787781991.963455:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12403:x1874624943050368:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 476us (784us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787781991.963463:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:3.0:1787781991.965934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.966062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943050496 00000100:00100000:0.0:1787781991.966072:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943050496 00000100:00100000:0.0:1787781991.966321:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:0.0:1787781991.966333:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12403:x1874624943050496:12345-192.168.206.16@tcp:103:lfs.0 00010000:00010000:0.0:1787781991.966349:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787781991.966374:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15063f27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c10 expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.966398:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15063f82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c25 expref: 65 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.966411:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15063e24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bca expref: 64 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.966421:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781991.966442:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781991.966507:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12403:x1874624943050496:12345-192.168.206.16@tcp:103:lfs.0 Request processed in 177us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.966515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:3.0:1787781991.972074:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781991.973996:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943050624 00000100:00100000:0.0:1787781991.974010:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943050624 00000100:00100000:0.0:1787781991.974075:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 184 00000100:00100000:0.0:1787781991.974086:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12403:x1874624943050624:12345-192.168.206.16@tcp:58:lfs.0 00010000:00010000:0.0:1787781991.974203:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.974221:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.974233:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781991.974334:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787781991.974492:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12403:x1874624943050624:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 406us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.974500:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 184 00000100:00100000:3.0:1787781992.015253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.015373:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943050752 00000100:00100000:0.0:1787781992.015383:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943050752 00000100:00100000:0.0:1787781992.015451:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 185 00000100:00100000:0.0:1787781992.015461:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12405:x1874624943050752:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781992.015491:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781992.015514:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063fa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c33 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015599:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015647:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015659:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015672:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015679:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015686:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015756:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015765:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015772:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781992.015811:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787781992.015816:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787781992.015835:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015858:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015866:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015873:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015879:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015886:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.015890:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015898:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015909:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781992.015912:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781992.015915:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015934:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15063fac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015947:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015954:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015967:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015978:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.015981:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015988:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.015998:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:0.0:1787781992.016001:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781992.016004:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.016011:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9800/0xc6d6745c15063fb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.016039:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15063fa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 65 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.016052:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 64 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.016060:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781992.016062:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781992.016064:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:0.0:1787781992.016130:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+64:12405:x1874624943050752:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 670us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781992.016147:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 185 00000040:00080000:1.0:1787781992.197765:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781992.197774:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781992.197808:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787781992.197816:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781992.197967:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963039104:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787781992.198062:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.202688:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963039104:192.168.206.16@tcp:107:hsm_cdtr.0 00000001:00080000:1.0:1787781992.207309:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:1.0:1787781992.207363:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1787781992.207440:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207451:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207459:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207488:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207492:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207500:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207516:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff993d679e1300) 00010000:00010000:3.0:1787781992.207519:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207523:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207529:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063d67 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207550:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207556:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207562:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207568:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207571:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207577:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207591:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781992.207594:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207597:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207603:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063d6e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207637:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207643:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207650:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207655:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207658:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207664:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207671:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1500) 00010000:00010000:3.0:1787781992.207673:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207676:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207681:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063dad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207703:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207710:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207715:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207720:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207723:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207729:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207736:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781992.207738:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207741:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207747:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c15063eb0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207757:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207763:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207768:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207779:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207782:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207787:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207795:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781992.207797:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207800:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207805:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15063ed3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207817:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207823:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207829:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207834:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.207837:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207843:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207861:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781992.207863:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.207866:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.207872:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15063f19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.210041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.210088:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943050880 00000100:00100000:3.0:1787781992.210097:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943050880 00000100:00100000:3.0:1787781992.210150:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 186 00000100:00100000:3.0:1787781992.210160:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:12416:x1874624943050880:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787781992.210191:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787781992.210311:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:12416:x1874624943050880:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 151us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.210319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 186 00000100:00100000:2.0:1787781992.212121:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781992.212142:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963039232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787781992.212204:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781992.212252:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963039232 00000100:00100000:2.0:1787781992.212603:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963039232 00000100:00100000:2.0:1787781992.212667:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787781992.212675:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963039232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787781992.212699:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787781992.212726:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6365, atime: 0x6a8f6365, ctime: 0x6a8f6365, blocks: 0x8 00010000:00010000:2.0:1787781992.212734:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.212749:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1787781992.212753:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781992.212759:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.212774:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.212795:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.212802:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.212818:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787781992.213031:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963039232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 355us (827us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787781992.213038:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1787781992.213063:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781992.213069:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.213077:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787781992.213081:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.213090:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.213106:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.213114:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060101c66/0xc6d6745c15063fc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.213137:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781992.213139:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781992.213141:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787781992.213170:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43c69e00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787781992.213177:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963039232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787781992.216101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.216199:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943051008 00000100:00100000:3.0:1787781992.216209:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943051008 00000100:00100000:3.0:1787781992.216280:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 187 00000100:00100000:3.0:1787781992.216289:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:12416:x1874624943051008:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.216363:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216378:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216390:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216463:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216471:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216478:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216505:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216514:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216521:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781992.216564:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787781992.216568:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781992.216580:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216591:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216597:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216603:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216639:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.216643:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216650:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216662:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:3.0:1787781992.216665:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.216670:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216676:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15063fc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216690:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216696:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216702:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216708:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.216710:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216716:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216734:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.216737:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.216740:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216746:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15063fcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216761:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216767:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216773:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216778:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781992.216781:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216788:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216795:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:3.0:1787781992.216797:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.216801:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.216807:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15063fd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.216883:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43dd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+33:12416:x1874624943051008:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 Request processed in 593us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.216905:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 187 00000020:00080000:1.0:1787781992.217946:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d799a3540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787781992.217954:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d43233700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d799a3000 00000020:00080000:1.0:1787781992.217957:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d43233c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993d80acf200 00000020:00080000:1.0:1787781992.218010:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787781992.218078:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787781992.221941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.222036:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943051264 00000100:00100000:0.0:1787781992.222046:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943051264 00000100:00100000:0.0:1787781992.222107:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:0.0:1787781992.222117:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+17:12416:x1874624943051264:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781992.222138:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781992.222159:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063fdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c3a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222282:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222298:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222310:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781992.222321:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787781992.222432:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222441:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222447:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222453:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.222457:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222472:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222486:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781992.222489:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781992.222493:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222500:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15063fe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222539:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063fdd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c3a expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222548:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:0.0:1787781992.222550:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781992.222553:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15063fdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c3a expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.222562:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166a00, rc 0) 00000100:00100000:0.0:1787781992.222651:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943051264:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 534us (717us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1787781992.222659:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 188 00000100:00100000:3.0:1787781992.224646:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.224745:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943051392 00000100:00100000:2.0:1787781992.224753:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943051392 00000100:00100000:2.0:1787781992.224801:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00100000:2.0:1787781992.224811:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943051392:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781992.224844:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781992.224966:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943051392:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 157us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.224975:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 189 00000100:00100000:2.0:1787781992.232649:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.232749:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943051648 00000100:00100000:0.0:1787781992.232758:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943051648 00000100:00100000:0.0:1787781992.232821:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:0.0:1787781992.232830:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943051648:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781992.232858:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781992.232861:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787781992.232887:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c15063f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c2c expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.232915:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781992.232928:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781992.232941:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063ff2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c41 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781992.233286:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787781992.233408:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063ff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.233420:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.233429:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.233476:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15063ff2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c41 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.233490:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c41 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.233496:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d679e1200) 00010000:00010000:0.0:1787781992.233499:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781992.233507:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:0.0:1787781992.233568:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943051648:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 738us (928us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787781992.233576:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 190 00000100:00100000:3.0:1787781992.245773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.246336:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943051904 00000100:00100000:0.0:1787781992.246346:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943051904 00000100:00100000:0.0:1787781992.246398:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00100000:0.0:1787781992.246408:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943051904:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781992.246465:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781992.246504:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15063ff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c41 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246522:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d679e1200) 00010000:00010000:0.0:1787781992.246532:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781992.246553:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246565:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246575:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246588:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246595:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246602:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246674:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246681:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246687:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246694:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.246698:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246706:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246714:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:0.0:1787781992.246718:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781992.246722:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246728:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064007 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246737:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246743:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246749:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246762:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.246766:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246775:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246785:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd317e419 (ffff993d679e1e00) 00010000:00010000:0.0:1787781992.246788:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781992.246791:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.246798:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506400e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd317e419 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.246894:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943051904:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 486us (1128us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781992.246902:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 191 00000100:00100000:0.0:1787781992.253019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.253096:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943052032 00000100:00100000:3.0:1787781992.253106:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943052032 00000100:00100000:3.0:1787781992.253165:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 192 00000100:00100000:3.0:1787781992.253175:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12416:x1874624943052032:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.253193:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781992.253216:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15064015 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c48 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253250:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253274:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253285:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253395:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c15064015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253412:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.253433:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.253436:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787781992.253440:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704600, rc 0) 00000100:00100000:3.0:1787781992.253507:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943052032:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 333us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.253515:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 192 00000100:00100000:1.0:1787781992.258734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.258807:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943052288 00000100:00100000:0.0:1787781992.258819:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943052288 00000100:00100000:0.0:1787781992.258893:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 193 00000100:00100000:0.0:1787781992.258903:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943052288:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781992.259000:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.259017:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.259048:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781992.259217:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787781992.259228:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429340620089ns, next at 430340617129ns, rc = 0 00000004:00010000:0.0:1787781992.259296:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faf4bc1a reply state 000000001573e2e8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.259309:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.259317:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:0.0:1787781992.259320:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787781992.259323:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781992.259421:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12416:x1874624943052288:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 519us (699us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787781992.259430:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 193 00000100:00100000:1.0:1787781992.268250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.268378:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943052416 00000100:00100000:3.0:1787781992.268388:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943052416 00000100:00100000:3.0:1787781992.268441:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 194 00000100:00100000:3.0:1787781992.268451:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12416:x1874624943052416:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.268472:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781992.268493:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c4f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.268547:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.268573:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.268591:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.268595:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781992.268598:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704800, rc 0) 00000100:00100000:3.0:1787781992.269061:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12416:x1874624943052416:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 610us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.269084:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 194 00000100:00100000:1.0:1787781992.277053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.277233:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943052544 00000100:00100000:3.0:1787781992.277243:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943052544 00000100:00100000:3.0:1787781992.277326:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:3.0:1787781992.277336:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+6:2407:x1874624943052544:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787781992.277546:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943052544:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 210us (501us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787781992.277554:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00080000:1.0:1787781992.277791:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781992.283518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.283634:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943052800 00000100:00100000:2.0:1787781992.283643:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943052800 00000100:00100000:2.0:1787781992.283701:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:2.0:1787781992.283711:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12416:x1874624943052800:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781992.283994:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12416:x1874624943052800:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 283us (483us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787781992.284003:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:1.0:1787781992.293080:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.293734:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053056 00000100:00100000:2.0:1787781992.293745:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053056 00000100:00100000:2.0:1787781992.293846:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 195 00000100:00100000:2.0:1787781992.293857:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12416:x1874624943053056:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787781992.294027:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12416:x1874624943053056:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 169us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.294036:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 195 00000100:00100000:1.0:1787781992.304718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.311770:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053184 00000100:00100000:0.0:1787781992.311784:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053184 00000100:00100000:1.0:1787781992.312753:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 196 00000100:00100000:1.0:1787781992.312765:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12416:x1874624943053184:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781992.312797:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781992.312818:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064031 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c56 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.312884:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.312898:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.312909:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781992.312961:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781992.312981:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.313008:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064031 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c56 expref: 25 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.313024:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c56 expref: 24 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.313033:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:1.0:1787781992.313036:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781992.313039:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:1.0:1787781992.313098:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12416:x1874624943053184:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 336us (8391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.313106:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 196 00000100:00100000:1.0:1787781992.330275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.330453:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053312 00000100:00100000:3.0:1787781992.330463:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053312 00000100:00100000:3.0:1787781992.330548:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:3.0:1787781992.330559:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943053312:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.330578:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781992.330599:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c5d expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781992.330655:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6367, blocks: 0x0 00010000:00010000:3.0:1787781992.330675:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1787781992.330680:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781992.330689:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.330707:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.330739:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705400, rc 0) 00000100:00100000:3.0:1787781992.330795:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943053312:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 237us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.330802:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:1.0:1787781992.334356:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.334592:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053568 00000100:00100000:3.0:1787781992.334601:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053568 00000100:00100000:3.0:1787781992.334732:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 197 00000100:00100000:3.0:1787781992.334741:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12416:x1874624943053568:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781992.334836:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12416:x1874624943053568:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 95us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.334843:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 197 00000100:00100000:1.0:1787781992.346958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.347060:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053696 00000100:00100000:2.0:1787781992.347071:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053696 00000100:00100000:2.0:1787781992.347131:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:2.0:1787781992.347142:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:12416:x1874624943053696:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781992.347160:0:8638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781992.347178:0:8638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c64 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.347218:0:8638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.347227:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781992.347231:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781992.347237:0:8638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.347268:0:8638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.347281:0:8638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 9 pid: 8446 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.347317:0:8638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963039360:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781992.347459:0:8638:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.350646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.350732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053824 00000100:00100000:3.0:1787781992.350742:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053824 00010000:00010000:3.0:1787781992.350786:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 10 pid: 8446 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.350828:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 87 00000100:00100000:3.0:1787781992.350837:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2408:x1874624943053824:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781992.350853:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.350873:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 10 pid: 8446 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.350886:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 10 pid: 8446 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.350944:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781992.350949:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781992.350958:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 10 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.350968:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 10 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.351005:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 10 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.351019:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6516:1874624963039488:192.168.206.16@tcp:105: 00000100:00100000:3.0:1787781992.351088:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d50c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787781992.351232:0:8638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bce646e/0xc6d6745c1506403f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c5d expref: 10 pid: 8446 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.351248:0:8638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43cab0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963039360:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781992.351271:0:8638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.351281:0:8638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5000, rc 0) 00000100:00100000:2.0:1787781992.351310:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:12416:x1874624943053696:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 4170us (4360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.351318:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:1.0:1787781992.356351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.356433:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943053952 00000100:00100000:2.0:1787781992.356443:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943053952 00002000:00100000:2.0:1787781992.356496:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff993d7fa95680 x1874624943053952/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:138/0 lens 504/0 e 0 to 0 dl 1787782003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781992.356506:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa95680 with x1874624943053952 ext(0->8) 00002000:00010000:2.0:1787781992.356512:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa95680 00000100:00100000:2.0:1787781992.356551:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:2.0:1787781992.356561:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943053952:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787781992.357539:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:2408:x1874624943053952:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 Request processed in 974us (1191us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787781992.357550:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00002000:00100000:1.0:1787781992.357560:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff993d7fa95680 x1874624943053952/t4294967315(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:138/0 lens 504/448 e 0 to 0 dl 1787782003 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781992.357570:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa95680 with x1874624943053952 ext(0->8) 00002000:00010000:1.0:1787781992.357575:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa95680 00000100:00100000:3.0:1787781992.357765:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6516:1874624963039488:192.168.206.16@tcp:105: 00010000:00010000:3.0:1787781992.357786:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781992.357810:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2408:x1874624943053824:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 6974us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.357819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 87 00000100:00100000:0.0:1787781992.360514:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781992.360650:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054080 00000100:00100000:1.0:1787781992.360660:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054080 00000100:00100000:1.0:1787781992.360719:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00100000:1.0:1787781992.360728:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12416:x1874624943054080:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787781992.363455:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787781992.363503:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787781992.363535:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1787781992.363552:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363571:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363580:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363588:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781992.363658:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363667:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363685:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:0.0:1787781992.363689:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787781992.363693:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.363700:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166800/0xc6d6745c15064023 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.363934:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781992.363953:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963039616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787781992.364029:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781992.364117:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963039616 00000100:00100000:3.0:1787781992.364124:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963039616 00000100:00100000:3.0:1787781992.364176:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781992.364185:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963039616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787781992.364314:0:13830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787781992.364318:0:13830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787781991 00002000:00010000:3.0:1787781992.364328:0:13830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787781992.364330:0:13830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787781991 -> 1787781991 00002000:00010000:3.0:1787781992.364332:0:13830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787781992.364376:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3660:x1874624963039616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (346us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787781992.364384:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1787781992.364553:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993d67d40780/2, rc 0, transno 4294967316 00000100:00100000:3.0:1787781992.364560:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963039616:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787781992.364789:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787781992.364801:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787781992.364903:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943054080:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 Request processed in 4173us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.364912:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 198 00000100:00100000:2.0:1787781992.368125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.368300:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054208 00000100:00100000:3.0:1787781992.368313:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054208 00000100:00100000:3.0:1787781992.368393:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:3.0:1787781992.368405:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2408:x1874624943054208:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787781992.370835:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1787781992.370849:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787781992.371049:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43cab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943054208:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 Request processed in 2639us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.371060:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:2.0:1787781992.376339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.376432:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054464 00000100:00100000:3.0:1787781992.376442:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054464 00000100:00100000:3.0:1787781992.376584:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 199 00000100:00100000:3.0:1787781992.376595:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943054464:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.376683:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.376709:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064038 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c56 expref: 19 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.376728:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.376733:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781992.376759:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.376772:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.376801:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781992.376930:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4456a3e reply state 00000000676eeb9c transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.376944:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.376951:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.376954:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781992.376956:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781992.377053:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:12416:x1874624943054464:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 460us (721us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787781992.377060:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 199 00000100:00100000:0.0:1787781992.380049:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.380510:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054592 00000100:00100000:2.0:1787781992.380519:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054592 00000100:00100000:2.0:1787781992.380643:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:2.0:1787781992.380653:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943054592:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787781992.380804:0:8638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787781992.380807:0:8638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787781991 -> 1787781991 00002000:00010000:2.0:1787781992.380810:0:8638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787781989 00002000:00010000:2.0:1787781992.380812:0:8638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787781991 -> 1787781991 00002000:00010000:2.0:1787781992.380815:0:8638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787781992.380888:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943054592:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 236us (847us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787781992.380896:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:1.0:1787781992.384436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.385442:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054848 00000100:00100000:3.0:1787781992.385456:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054848 00000100:00100000:3.0:1787781992.385529:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:3.0:1787781992.385540:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:12416:x1874624943054848:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.385640:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.385659:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.385669:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.385708:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.385739:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 20 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.385753:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963039744:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781992.385834:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781992.398126:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963039744:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781992.398156:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.403978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.404442:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943054976 00000100:00100000:3.0:1787781992.404452:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943054976 00010000:00010000:3.0:1787781992.404502:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 21 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.404541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 88 00000100:00100000:3.0:1787781992.404550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:2408:x1874624943054976:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781992.404564:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.404572:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 21 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404585:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 21 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c1506401c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c48 expref: 21 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404671:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.404676:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404685:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404693:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.404719:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781992.404771:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:2408:x1874624943054976:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 221us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.404779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 88 00010000:00010000:1.0:1787781992.405100:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405116:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405155:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405162:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405169:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405175:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781992.405180:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405186:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405196:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:1.0:1787781992.405199:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787781992.405203:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.405209:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064054 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.405266:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943054848:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 Request processed in 19728us (20837us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787781992.405276:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 200 00000100:00100000:1.0:1787781992.412437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.412539:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055104 00000100:00100000:0.0:1787781992.412549:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055104 00000100:00100000:0.0:1787781992.412640:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:0.0:1787781992.412650:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2407:x1874624943055104:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787781992.412694:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.412714:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 8 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.412722:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781992.412740:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781992.412745:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.412778:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 8 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.412791:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 8 pid: 8638 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.412804:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1874624963039872:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781992.412877:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781992.416509:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1874624963039872:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781992.416539:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.416966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781992.417155:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055232 00000100:00100000:1.0:1787781992.417163:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055232 00010000:00010000:1.0:1787781992.417200:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.417235:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 89 00000100:00100000:1.0:1787781992.417245:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943055232:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781992.417261:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781992.417282:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.417295:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.417317:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064046 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c64 expref: 9 pid: 8638 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.417332:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781992.417336:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781992.417341:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.417351:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.417387:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781992.417456:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943055232:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.417464:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 89 00010000:00010000:2.0:1787781992.417624:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417644:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417665:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417673:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417680:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417686:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787781992.417690:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417699:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417710:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.417717:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0d88b7f/0xc6d6745c1506405b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.417776:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2407:x1874624943055104:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 Request processed in 5128us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.417784:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:2.0:1787781992.421239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.421327:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055488 00000100:00100000:3.0:1787781992.421337:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055488 00000100:00100000:3.0:1787781992.421424:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 201 00000100:00100000:3.0:1787781992.421434:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12416:x1874624943055488:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787781992.421522:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.421541:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.421551:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.421584:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.421644:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 19 pid: 6531 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.421660:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040000:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781992.421837:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.425129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.425194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055616 00000100:00100000:0.0:1787781992.425202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055616 00010000:00010000:0.0:1787781992.425243:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 20 pid: 6531 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.425282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 90 00000100:00100000:0.0:1787781992.425292:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:2409:x1874624943055616:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781992.425307:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781992.425314:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 20 pid: 6531 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.425327:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 20 pid: 6531 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.425378:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:0.0:1787781992.425384:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.425393:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.425401:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.425419:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781992.425477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:2409:x1874624943055616:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 186us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781992.425485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 90 00010000:00010000:3.0:1787781992.426998:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8400/0xc6d6745c15063ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83bed expref: 19 pid: 6531 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.427020:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040000:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781992.427042:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427183:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427191:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427356:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427453:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427461:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427561:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.427576:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 19 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.427590:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040128:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781992.427859:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.430565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.430807:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040128:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781992.430831:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.430974:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055744 00000100:00100000:3.0:1787781992.430983:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055744 00010000:00010000:3.0:1787781992.431020:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 20 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.431059:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 91 00000100:00100000:3.0:1787781992.431068:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:2408:x1874624943055744:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781992.431095:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.431102:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 20 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431118:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 20 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431157:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506402a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c4f expref: 20 pid: 6533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431171:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781992.431175:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431183:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431190:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.431220:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781992.431268:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:2408:x1874624943055744:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 201us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.431276:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 91 00010000:00010000:0.0:1787781992.431526:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.431534:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781992.431678:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787781992.431802:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787781992.431838:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787781992.431942:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963040256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787781992.431997:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781992.432023:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.432480:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963040256 00000100:00100000:1.0:1787781992.432488:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963040256 00000100:00100000:1.0:1787781992.432542:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787781992.432552:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963040256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787781992.432669:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963040256:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.432677:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787781992.432865:0:6532:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787781992.432871:0:6532:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993d67d40780, transno 4294967316 00000100:00100000:0.0:1787781992.432890:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963040256:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787781992.433032:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1787781992.433255:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963040384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787781992.433293:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781992.433323:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781992.433397:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963040384 00000100:00100000:3.0:1787781992.433402:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963040384 00000100:00100000:3.0:1787781992.433441:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787781992.433450:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6532:x1874624963040384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787781992.433643:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c42692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6532:x1874624963040384:12345-0@lo:1000:mdt00_001.0 Request processed in 193us (349us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787781992.433650:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787781992.434867:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c426903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874624963040384:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787781992.434972:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.434982:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.434990:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.434996:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfbe00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781992.435000:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435008:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435022:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:2.0:1787781992.435025:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781992.435047:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435053:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c15064069 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435089:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435096:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435102:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435107:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781992.435110:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435116:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435124:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781992.435127:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781992.435130:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435136:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15063f9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435160:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435176:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435194:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435236:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.435252:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 22 pid: 6532 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.435265:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040512:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781992.435394:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787781992.441965:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4c0e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963040512:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781992.441995:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.442173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.442295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943055872 00000100:00100000:2.0:1787781992.442302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943055872 00010000:00010000:2.0:1787781992.442336:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 23 pid: 6532 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.442382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 92 00000100:00100000:2.0:1787781992.442391:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:2408:x1874624943055872:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781992.442406:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781992.442412:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 23 pid: 6532 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442442:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 23 pid: 6532 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442465:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15063fba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c33 expref: 23 pid: 6532 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442492:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:2.0:1787781992.442497:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442507:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.442542:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781992.442591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:2408:x1874624943055872:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.442599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 92 00010000:00010000:1.0:1787781992.443379:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443392:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443404:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443410:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443417:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443424:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781992.443427:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443434:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443446:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781992.443449:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.443453:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443481:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064070 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443494:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443500:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443506:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443510:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781992.443514:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443520:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443529:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993d6d097100) 00010000:00010000:1.0:1787781992.443531:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781992.443534:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.443539:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064062 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.443783:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4beaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12416:x1874624943055488:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 22348us (22550us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787781992.443794:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 201 00000020:00080000:1.0:1787781992.443805:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781992.444334:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781992.444339:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781992.445071:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787781992.445146:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781992.451037:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781992.451234:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056128 00000100:00100000:0.0:1787781992.451244:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056128 00000100:00100000:0.0:1787781992.451303:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:0.0:1787781992.451313:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12416:x1874624943056128:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787781992.451564:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787781992.451594:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1787781992.451662:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451678:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451689:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451697:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451704:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451710:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781992.451730:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787781992.451812:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12416:x1874624943056128:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 499us (783us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787781992.451835:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 50 00000020:00080000:0.0:1787781992.451840:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787781992.452184:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781992.452192:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.452199:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787781992.452209:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.452218:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.452230:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:2.0:1787781992.452234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787781992.452238:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.452244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064077 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.452257:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781992.452259:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781992.452260:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781992.457446:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781992.457526:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781992.457595:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963040640 00000100:00100000:3.0:1787781992.457602:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963040640 00000100:00100000:3.0:1787781992.457672:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781992.457682:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963040640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787781992.457710:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787781992.457752:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963040640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.457759:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781992.457822:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67d42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787781992.458998:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963040768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781992.459051:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.459212:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963040768 00000100:00100000:1.0:1787781992.459220:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963040768 00000100:00100000:1.0:1787781992.459267:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787781992.459275:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963040768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781992.459294:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787781992.459336:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963040768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.459345:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787781992.460275:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963040768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781992.518173:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781992.841629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.841667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.841702:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056384 00000100:00100000:3.0:1787781992.841711:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056384 00000100:00080000:2.0:1787781992.841743:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781992.841775:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056640 00000100:00100000:3.0:1787781992.841779:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056640 00000100:00100000:3.0:1787781992.841812:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 336 00000100:00100000:3.0:1787781992.841822:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943056384:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781992.841894:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d503221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943056384:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.841902:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 336 00000100:00100000:3.0:1787781992.841929:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 337 00000100:00100000:3.0:1787781992.841936:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943056640:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781992.841977:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943056640:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.841983:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 337 00000100:00080000:3.0:1787781992.841999:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781992.847103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781992.847137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.847210:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056256 00000100:00100000:3.0:1787781992.847219:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056256 00000100:00100000:3.0:1787781992.847265:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 389 00000100:00100000:3.0:1787781992.847274:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943056256:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781992.847339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943056256:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.847347:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 389 00000100:00100000:2.0:1787781992.848523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781992.848759:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056768 00000100:00100000:3.0:1787781992.848767:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056768 00000100:00100000:3.0:1787781992.848820:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 338 00000100:00100000:3.0:1787781992.848829:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943056768:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787781992.848880:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943056768:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.848887:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 338 00000100:00080000:3.0:1787781992.848909:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787781992.849066:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943056512 00000100:00100000:1.0:1787781992.849073:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943056512 00000100:00100000:1.0:1787781992.849158:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00100000:1.0:1787781992.849168:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943056512:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781992.849205:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943056512:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 39us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.849212:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00080000:3.0:1787781992.853461:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787781992.870318:0:14722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781992.870327:0:14722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781992.870350:0:14722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787781992.870356:0:14722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781992.965732:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781992.965739:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963041024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781992.965747:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963040896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787781992.970057:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781992.973858:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781992.980356:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963040896 00000100:00100000:0.0:1787781992.980368:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963040896 00000100:00100000:0.0:1787781992.980429:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963041024 00000100:00100000:0.0:1787781992.980433:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963041024 00000100:00100000:0.0:1787781992.980451:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787781992.980461:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963040896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787781992.980483:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787781992.980564:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963040896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (10511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781992.980571:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787781992.980587:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787781992.980594:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963041024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781992.980603:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787781992.980651:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963041024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (6798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781992.980657:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787781992.980901:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c41d461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963040896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787781992.980954:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963041024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781993.012549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.012769:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943057024 00000100:00100000:3.0:1787781993.012778:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943057024 00000100:00080000:2.0:1787781993.013416:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781993.013463:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 202 00000100:00100000:3.0:1787781993.013481:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:12426:x1874624943057024:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781993.013515:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.013536:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506407e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c6b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.013665:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15064085 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.013680:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15064085 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.013692:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15064085 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781993.013703:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787781993.013796:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c1506407e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c6b expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.013811:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15064085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c6b expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.013818:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781993.013821:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781993.013824:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705e00, rc 0) 00000100:00100000:3.0:1787781993.013885:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:12426:x1874624943057024:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 406us (1341us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787781993.013892:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 202 00000100:00100000:3.0:1787781993.021101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.021171:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943057152 00000100:00100000:1.0:1787781993.021181:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943057152 00000100:00100000:1.0:1787781993.021267:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 203 00000100:00100000:1.0:1787781993.021277:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:12426:x1874624943057152:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:1.0:1787781993.021361:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021379:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021390:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021415:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021423:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021430:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021498:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021516:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021524:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781993.021570:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021582:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021588:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021594:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021599:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.021603:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021681:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021693:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781993.021695:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.021700:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021706:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c15064093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021716:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021721:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021727:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021732:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.021735:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021740:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021746:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526d00) 00010000:00010000:1.0:1787781993.021748:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.021750:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021765:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c1506409a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021779:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021784:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021790:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021794:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.021797:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021803:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021811:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526b00) 00010000:00010000:1.0:1787781993.021813:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.021816:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.021821:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.021889:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:12426:x1874624943057152:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 613us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.021897:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 203 00000100:00100000:0.0:1787781993.090814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.090991:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943057408 00000100:00100000:1.0:1787781993.091000:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943057408 00000100:00100000:1.0:1787781993.091055:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 204 00000100:00100000:1.0:1787781993.091065:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+25:12429:x1874624943057408:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.091085:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.091104:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c72 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091171:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091186:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091197:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091210:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091217:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091224:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091323:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091331:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091350:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.091360:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787781993.091438:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091446:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091453:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091459:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.091462:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091469:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091482:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781993.091485:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.091489:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091496:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c150640af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091689:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091697:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091711:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091718:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.091721:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091727:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091736:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:1.0:1787781993.091738:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.091742:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091747:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c150640b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091790:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c150640a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 28 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091805:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 27 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.091813:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:1.0:1787781993.091815:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781993.091818:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa000, rc 0) 00000100:00100000:1.0:1787781993.091990:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c41d461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12429:x1874624943057408:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 925us (1184us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787781993.092009:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 204 00000100:00100000:2.0:1787781993.100033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.100225:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943057536 00000100:00100000:3.0:1787781993.100244:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943057536 00000100:00100000:3.0:1787781993.100336:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 205 00000100:00100000:3.0:1787781993.100347:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12429:x1874624943057536:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:3.0:1787781993.100410:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100426:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100438:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100470:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100477:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100484:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100490:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781993.100494:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100501:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100528:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781993.100530:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781993.100535:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.100551:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.100647:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12429:x1874624943057536:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 302us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.100655:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 205 00000100:00100000:1.0:1787781993.105461:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.105586:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943057792 00000100:00100000:2.0:1787781993.105596:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943057792 00000100:00100000:2.0:1787781993.105683:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:2.0:1787781993.105694:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12429:x1874624943057792:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781993.106250:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:12429:x1874624943057792:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 557us (796us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787781993.106263:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:2.0:1787781993.144488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.144641:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058048 00000100:00100000:3.0:1787781993.144650:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058048 00000100:00100000:3.0:1787781993.144710:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 206 00000100:00100000:3.0:1787781993.144722:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:11962:x1874624943058048:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781993.144745:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.144765:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c79 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.144866:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.144880:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 29 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.144887:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.144930:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 29 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.144944:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 29 pid: 10060 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.144979:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963041152:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781993.145243:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781993.149929:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963041152:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781993.149957:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.151998:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.152113:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058176 00000100:00100000:3.0:1787781993.152123:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058176 00010000:00010000:3.0:1787781993.152208:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 30 pid: 10060 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.152250:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 93 00000100:00100000:3.0:1787781993.152261:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:2409:x1874624943058176:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781993.152277:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781993.152284:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 30 pid: 10060 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152299:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 30 pid: 10060 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152321:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150640bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c72 expref: 30 pid: 10060 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152337:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781993.152343:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152368:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152376:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.152411:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781993.152489:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.152499:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.152517:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:3.0:1787781993.152525:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:2409:x1874624943058176:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 264us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.152544:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 93 00010000:00010000:2.0:1787781993.152683:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150640d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.152700:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 29 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.152707:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.152710:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781993.152713:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704200, rc 0) 00000100:00100000:2.0:1787781993.152739:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d413252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:11962:x1874624943058048:12345-192.168.206.16@tcp:101:bash.0 Request processed in 8021us (8258us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787781993.152746:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 206 00000100:00100000:0.0:1787781993.155724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.156652:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058304 00000100:00100000:2.0:1787781993.156662:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058304 00000100:00100000:2.0:1787781993.156722:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 207 00000100:00100000:2.0:1787781993.156733:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:11962:x1874624943058304:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781993.156770:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.156790:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150640e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c80 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.156834:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150640ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.156847:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150640ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.156859:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150640ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.156985:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c150640e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c80 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.157015:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150640ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c80 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.157023:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.157026:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781993.157029:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4800, rc 0) 00000100:00100000:2.0:1787781993.157087:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4c0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11962:x1874624943058304:12345-192.168.206.16@tcp:101:bash.0 Request processed in 357us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.157094:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 207 00000100:00100000:1.0:1787781993.161869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.161960:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058560 00000100:00100000:2.0:1787781993.161970:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058560 00000100:00100000:2.0:1787781993.162034:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 208 00000100:00100000:2.0:1787781993.162045:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:11962:x1874624943058560:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:2.0:1787781993.162282:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.162298:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.162309:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781993.162350:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1787781993.162371:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044f5a32d reply state 0000000087916bd2 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.162383:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.162390:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.162393:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781993.162397:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787781993.162433:0:10060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1787781993.162521:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:11962:x1874624943058560:12345-192.168.206.16@tcp:36:bash.0 Request processed in 477us (748us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787781993.162528:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 208 00000020:00080000:2.0:1787781993.162533:0:10060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787781993.164998:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.165440:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058688 00000100:00100000:3.0:1787781993.165450:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058688 00000100:00100000:3.0:1787781993.165516:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 209 00000100:00100000:3.0:1787781993.165524:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+34:11962:x1874624943058688:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781993.165547:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.165567:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c150640fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c87 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.165655:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c150640fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c87 expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.165671:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c150640fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c87 expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.165690:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781993.165693:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781993.165697:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705800, rc 0) 00000100:00100000:3.0:1787781993.165772:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:11962:x1874624943058688:12345-192.168.206.16@tcp:101:bash.0 Request processed in 248us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.165779:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 209 00000100:00100000:0.0:1787781993.170416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.170527:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058816 00000100:00100000:2.0:1787781993.170536:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058816 00000100:00100000:2.0:1787781993.170593:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:2.0:1787781993.170603:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:11962:x1874624943058816:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781993.170652:0:8638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.170675:0:8638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c8e expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781993.170714:0:8638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6367, atime: 0x6a8f6365, ctime: 0x6a8f6367, blocks: 0x8 00010000:00010000:2.0:1787781993.170736:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1787781993.170741:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781993.170749:0:8638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 8 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.170769:0:8638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 8 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.170782:0:8638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5c00, rc 0) 00000100:00100000:2.0:1787781993.170830:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:11962:x1874624943058816:12345-192.168.206.16@tcp:101:bash.0 Request processed in 229us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.170852:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:3.0:1787781993.175539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.175809:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943058944 00000100:00100000:2.0:1787781993.175818:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943058944 00002000:00010000:2.0:1787781993.175869:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787781993.175875:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa0c780 with x1874624943058944 ext(0->18446744073709551615) 00002000:00010000:2.0:1787781993.175886:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa0c780. 00000100:00100000:2.0:1787781993.175933:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:2.0:1787781993.175945:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943058944:12345-192.168.206.16@tcp:10:bash.0 00002000:00010000:2.0:1787781993.176182:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787781993.176186:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787781991 -> 1787781992 00002000:00010000:2.0:1787781993.176188:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787781989 -> 1787781989 00002000:00010000:2.0:1787781993.176190:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787781991 -> 1787781992 00002000:00010000:2.0:1787781993.176204:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787781993.176270:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943058944:12345-192.168.206.16@tcp:10:bash.0 Request processed in 326us (737us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787781993.176277:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00002000:00010000:2.0:1787781993.176281:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787781993.176284:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa0c780 with x1874624943058944 ext(0->18446744073709551615) 00002000:00010000:2.0:1787781993.176289:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa0c780. 00000100:00100000:0.0:1787781993.298250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.299119:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943059072 00000100:00100000:2.0:1787781993.299130:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943059072 00000100:00100000:2.0:1787781993.299194:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 210 00000100:00100000:2.0:1787781993.299205:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:12443:x1874624943059072:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:2.0:1787781993.299277:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299292:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299303:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299317:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299325:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299331:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299402:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299425:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.299433:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781993.300625:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300641:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300648:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300655:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300662:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781993.300666:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300673:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300689:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781993.300692:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.300696:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300701:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c1506410a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300731:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300737:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300743:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300748:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781993.300751:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300757:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300765:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c436a7500) 00010000:00010000:2.0:1787781993.300767:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.300771:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300777:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c15064111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300792:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300798:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300803:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300816:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781993.300819:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300826:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300834:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.300837:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.300839:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.300844:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.301053:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:12443:x1874624943059072:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 1848us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.301063:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 210 00000100:00100000:3.0:1787781993.358174:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781993.358328:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943059328 00000100:00100000:0.0:1787781993.358338:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943059328 00000100:00100000:0.0:1787781993.358403:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 211 00000100:00100000:0.0:1787781993.358413:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+35:12446:x1874624943059328:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787781993.358438:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781993.358477:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506411f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c95 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358547:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358562:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358582:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358597:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358644:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.358652:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359104:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15064134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359117:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15064134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359125:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15064134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.359137:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787781993.359228:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359235:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359242:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359248:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.359253:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359259:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359271:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781993.359274:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.359294:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359300:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359313:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359318:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359323:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359328:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.359331:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359337:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359344:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d679e1e00) 00010000:00010000:1.0:1787781993.359347:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.359349:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359354:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c1506412d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359396:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c1506411f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c95 expref: 38 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359419:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15064134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c95 expref: 37 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.359425:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:1.0:1787781993.359427:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781993.359429:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa800, rc 0) 00000100:00100000:1.0:1787781993.359504:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12446:x1874624943059328:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1093us (1341us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787781993.359511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 211 00000100:00100000:3.0:1787781993.365434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.365511:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943059456 00000100:00100000:2.0:1787781993.365520:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943059456 00000100:00100000:2.0:1787781993.365660:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 212 00000100:00100000:2.0:1787781993.365671:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12446:x1874624943059456:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:2.0:1787781993.365746:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.365762:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.365772:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.365827:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.365840:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 37 pid: 6531 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.365853:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963041280:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781993.366552:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781993.374821:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.374981:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943059712 00000100:00100000:3.0:1787781993.374991:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943059712 00000100:00100000:3.0:1787781993.375047:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:3.0:1787781993.375057:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:6189:x1874624943059712:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787781993.375355:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:6189:x1874624943059712:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 299us (543us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787781993.375364:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:2.0:1787781993.375503:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963041280:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781993.375531:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.381996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.382214:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943059840 00000100:00100000:2.0:1787781993.382227:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943059840 00010000:00010000:2.0:1787781993.382272:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 39 pid: 6531 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.382320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 94 00000100:00100000:2.0:1787781993.382330:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:2408:x1874624943059840:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781993.382348:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781993.382356:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 39 pid: 6531 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382370:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 39 pid: 6531 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382422:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704200/0xc6d6745c150640d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c79 expref: 39 pid: 6531 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382440:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.382445:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382455:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382476:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.382649:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781993.382859:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:2408:x1874624943059840:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 529us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.382868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 94 00010000:00010000:3.0:1787781993.385250:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.385267:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.385314:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.385321:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.385329:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.385335:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781993.387180:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.387197:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.387217:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781993.387220:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781993.387226:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.387233:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4a00/0xc6d6745c15064142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.387339:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c4a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12446:x1874624943059456:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 21666us (21910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.387350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 212 00000100:00100000:3.0:1787781993.391799:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.391891:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943060096 00000100:00100000:2.0:1787781993.391900:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943060096 00000100:00100000:2.0:1787781993.391965:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:2.0:1787781993.391975:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+37:12446:x1874624943060096:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781993.392197:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:12446:x1874624943060096:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 221us (404us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787781993.392205:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:1.0:1787781993.511413:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.511566:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943060352 00000100:00100000:3.0:1787781993.511575:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943060352 00000100:00100000:3.0:1787781993.511663:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 213 00000100:00100000:3.0:1787781993.511674:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+38:12457:x1874624943060352:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:3.0:1787781993.511698:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.511718:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15064149 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83c9c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511812:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511827:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511846:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511863:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511871:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511878:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.511994:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506415e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512005:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506415e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512013:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506415e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781993.512023:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787781993.512097:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512105:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512112:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512118:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781993.512129:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512137:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512150:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781993.512154:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781993.512158:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512165:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512180:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512187:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512194:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512200:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781993.512203:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512209:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512217:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993d67c66300) 00010000:00010000:3.0:1787781993.512219:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781993.512228:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512234:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512275:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15064149 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c9c expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512290:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506415e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c9c expref: 40 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.512298:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781993.512301:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781993.512304:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705400, rc 0) 00000100:00100000:3.0:1787781993.512368:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12457:x1874624943060352:12345-192.168.206.16@tcp:101:cat.0 Request processed in 696us (963us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787781993.512377:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 213 00000100:00100000:1.0:1787781993.521037:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781993.521198:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943060608 00000100:00100000:0.0:1787781993.521207:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943060608 00000100:00100000:0.0:1787781993.521269:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:0.0:1787781993.521279:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+40:12457:x1874624943060608:12345-192.168.206.16@tcp:35:cat.0 00000100:00100000:0.0:1787781993.521568:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+41:12457:x1874624943060608:12345-192.168.206.16@tcp:35:cat.0 Request processed in 289us (538us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787781993.521576:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00010000:00010000:1.0:1787781993.542093:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781993.546996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.547137:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943060864 00000100:00100000:1.0:1787781993.547147:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943060864 00000100:00100000:1.0:1787781993.547206:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 214 00000100:00100000:1.0:1787781993.547217:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+41:12458:x1874624943060864:12345-192.168.206.16@tcp:36:rm.0 00010000:00010000:1.0:1787781993.547271:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787781993.547299:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705800/0xc6d6745c150640fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c87 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547322:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c1506415e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c9c expref: 40 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547335:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c15064134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c95 expref: 39 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547392:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c150640ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c80 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547404:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:1.0:1787781993.547409:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781993.547430:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547443:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547453:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547480:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547489:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547496:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547568:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547576:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.547584:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781993.548219:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787781993.548230:0:10060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430629621912ns, next at 431629619271ns, rc = 0 00010000:00010000:1.0:1787781993.548277:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548288:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548296:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548304:0:10060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548311:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548317:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548440:0:10060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787781993.548472:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548479:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548485:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548490:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.548503:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548511:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548522:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:1.0:1787781993.548525:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787781993.548529:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548536:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c1506417a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548553:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548560:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548566:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548571:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfaa00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781993.548574:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548580:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548588:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781993.548590:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.548599:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548824:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfaa00/0xc6d6745c1506416c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781993.548839:0:10060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016276e95 reply state 00000000b6f7d5f4 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548850:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.548857:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:1.0:1787781993.548860:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787781993.548863:0:10060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781993.548988:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:12458:x1874624943060864:12345-192.168.206.16@tcp:36:rm.0 Request processed in 1770us (1997us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787781993.548997:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 214 00010000:00010000:2.0:1787781993.550236:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781993.550247:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.550275:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787781993.550280:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.550288:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.550302:0:10348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:2.0:1787781993.550305:0:10348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787781993.550309:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.550316:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb400/0xc6d6745c15064181 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.550331:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781993.550333:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781993.550335:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781993.616584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.616729:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061120 00000100:00100000:3.0:1787781993.616738:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061120 00000100:00100000:3.0:1787781993.616804:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 215 00000100:00100000:3.0:1787781993.616814:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+39:12464:x1874624943061120:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781993.616835:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.616854:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15064188 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ca3 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.616964:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.616999:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617011:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617024:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617031:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617038:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781993.617331:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787781993.617451:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617851:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617864:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617901:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617908:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617925:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617940:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781993.617944:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617952:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617965:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781993.617968:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781993.617972:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.617978:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c1506418f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781993.617991:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a84912a4 reply state 00000000bda555db transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.618004:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.618010:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:3.0:1787781993.618012:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787781993.618014:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787781993.618044:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c15064188 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.618059:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.618077:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:3.0:1787781993.618080:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781993.618083:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781993.618139:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:12464:x1874624943061120:12345-192.168.206.16@tcp:101:bash.0 Request processed in 1326us (1564us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787781993.618148:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 215 00000100:00100000:0.0:1787781993.627229:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.627330:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061248 00000100:00100000:2.0:1787781993.627341:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061248 00000100:00100000:2.0:1787781993.627402:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:2.0:1787781993.627411:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943061248:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781993.627429:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.627448:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83caa expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781993.627483:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787781993.627510:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1787781993.627530:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781993.627539:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.627559:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.627572:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5800, rc 0) 00000100:00100000:2.0:1787781993.627664:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943061248:12345-192.168.206.16@tcp:101:bash.0 Request processed in 253us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.627671:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:0.0:1787781993.630651:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.632006:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061376 00000100:00100000:3.0:1787781993.632018:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061376 00000100:00100000:3.0:1787781993.632090:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:3.0:1787781993.632099:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:12464:x1874624943061376:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787781993.632115:0:13830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.632132:0:13830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cb1 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.632162:0:13830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.632172:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781993.632176:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781993.632181:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 9 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.632214:0:13830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.632249:0:13830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.632264:0:13830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13830:1874624963041408:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781993.632361:0:13830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781993.640398:0:13830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13830:1874624963041408:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781993.640432:0:13830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 9 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.640451:0:13830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705a00, rc 0) 00000100:00100000:3.0:1787781993.640682:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:12464:x1874624943061376:12345-192.168.206.16@tcp:101:bash.0 Request processed in 8583us (10037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.640692:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:0.0:1787781993.642086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.642184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061504 00000100:00100000:2.0:1787781993.642193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061504 00010000:00010000:2.0:1787781993.642232:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.642281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 95 00000100:00100000:2.0:1787781993.642290:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943061504:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781993.642309:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781993.642331:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.642348:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.642372:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fa7473/0xc6d6745c150641ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83caa expref: 9 pid: 8445 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.642401:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781993.642406:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781993.642415:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.642426:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.642461:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.642487:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6516:1874624963041536:192.168.206.16@tcp:105: 00000100:00100000:2.0:1787781993.642564:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781993.650051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.650164:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6516:1874624963041536:192.168.206.16@tcp:105: 00010000:00010000:2.0:1787781993.650187:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781993.650244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943061504:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 7954us (8163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.650256:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 95 00000100:00100000:3.0:1787781993.650685:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061760 00000100:00100000:3.0:1787781993.650693:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061760 00000100:00100000:3.0:1787781993.650748:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:3.0:1787781993.650766:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+42:12464:x1874624943061760:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:3.0:1787781993.651018:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12464:x1874624943061760:12345-192.168.206.16@tcp:35:bash.0 Request processed in 253us (975us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787781993.651026:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787781993.826240:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.826328:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943061888 00000100:00100000:3.0:1787781993.826339:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943061888 00000100:00100000:3.0:1787781993.826400:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 216 00000100:00100000:3.0:1787781993.826410:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+43:12480:x1874624943061888:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781993.826452:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.826574:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150641b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826670:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826685:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826696:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781993.826736:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787781993.826739:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781993.826757:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826782:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704800/0xc6d6745c150641b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb8 expref: 45 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826799:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb8 expref: 44 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.826807:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781993.826810:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781993.826814:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705200, rc 0) 00000100:00100000:3.0:1787781993.826885:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:12480:x1874624943061888:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 476us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.826892:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 216 00000100:00100000:3.0:1787781993.831313:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.831421:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062144 00000100:00100000:1.0:1787781993.831430:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062144 00000100:00100000:1.0:1787781993.831498:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 217 00000100:00100000:1.0:1787781993.831516:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+44:12480:x1874624943062144:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.831535:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.831554:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c150641c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cbf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.831683:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c150641ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.831720:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c150641ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.831732:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c150641ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.831743:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787781993.831849:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c150641c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cbf expref: 47 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.831867:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c150641ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cbf expref: 46 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.831875:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:1.0:1787781993.831878:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781993.831881:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa800, rc 0) 00000100:00100000:1.0:1787781993.831946:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+46:12480:x1874624943062144:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 432us (641us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787781993.831952:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 217 00000100:00100000:0.0:1787781993.842056:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781993.842156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.842314:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062528 00000100:00100000:2.0:1787781993.842323:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062528 00000100:00100000:2.0:1787781993.842392:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:2.0:1787781993.842402:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+46:2408:x1874624943062528:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781993.842417:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781993.842443:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa800/0xc6d6745c150641ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cbf expref: 46 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.842489:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:2.0:1787781993.842495:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781993.842557:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:2408:x1874624943062528:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.842564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:1.0:1787781993.844250:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062400 00000100:00100000:1.0:1787781993.844263:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062400 00000100:00100000:1.0:1787781993.844388:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 218 00000100:00100000:1.0:1787781993.844398:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+45:12480:x1874624943062400:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.844421:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.844441:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c150641dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cc6 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.844576:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.844593:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.844664:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.844678:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787781993.844777:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb200/0xc6d6745c150641dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cc6 expref: 48 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.844794:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cc6 expref: 47 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.844803:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:1.0:1787781993.844806:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781993.844809:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfbc00, rc 0) 00000100:00100000:1.0:1787781993.844905:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:12480:x1874624943062400:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 508us (2856us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1787781993.844921:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 218 00000100:00100000:2.0:1787781993.860696:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.861234:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062656 00000100:00100000:3.0:1787781993.861245:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062656 00000100:00100000:3.0:1787781993.861795:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:3.0:1787781993.861808:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943062656:12345-192.168.206.16@tcp:1:lfs.0 00010000:00010000:3.0:1787781993.861855:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.861874:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.861883:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781993.861887:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781993.861893:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.861941:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.861956:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 8 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.861972:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1874624963041664:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781993.862063:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781993.870774:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1874624963041664:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781993.870805:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.878517:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781993.881146:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062784 00000100:00100000:0.0:1787781993.881161:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062784 00002000:00100000:0.0:1787781993.881220:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff993c43fe2d00 x1874624943062784/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:139/0 lens 504/0 e 0 to 0 dl 1787782004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781993.881232:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43fe2d00 with x1874624943062784 ext(0->8) 00010000:00010000:0.0:1787781993.881241:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 9 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.881260:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 9 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781993.881269:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993c43fe2d00 00000100:00100000:0.0:1787781993.881306:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:0.0:1787781993.881333:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2408:x1874624943062784:12345-192.168.206.16@tcp:4:lfs.0 00000100:00100000:0.0:1787781993.882741:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:2408:x1874624943062784:12345-192.168.206.16@tcp:4:lfs.0 Request processed in 1404us (4226us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787781993.882752:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00002000:00100000:0.0:1787781993.882761:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff993c43fe2d00 x1874624943062784/t4294967309(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:139/0 lens 504/448 e 0 to 0 dl 1787782004 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781993.882771:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993c43fe2d00 with x1874624943062784 ext(0->8) 00010000:00010000:0.0:1787781993.882780:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.882794:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781993.882802:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff993c43fe2d00 00000100:00100000:2.0:1787781993.886160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781993.886298:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943062912 00000100:00100000:3.0:1787781993.886308:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943062912 00010000:00010000:3.0:1787781993.886347:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781993.886387:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 96 00000100:00100000:3.0:1787781993.886397:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:2409:x1874624943062912:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781993.886412:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787781993.886436:0:9533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787781993.886439:0:9533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787781993 00002000:00010000:3.0:1787781993.886441:0:9533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787781993 00002000:00010000:3.0:1787781993.886444:0:9533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787781993 00002000:00010000:3.0:1787781993.886446:0:9533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787781993.886452:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.886482:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.886507:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede5bc64/0xc6d6745c150641b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb1 expref: 11 pid: 13830 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.886524:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781993.886528:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781993.886534:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.886559:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.886587:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781993.886679:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943062912:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 283us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.886688:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 96 00010000:00010000:0.0:1787781993.887577:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887591:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887646:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887656:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887679:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887686:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781993.887690:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887699:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887713:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.887720:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd3ea35/0xc6d6745c150641f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.887782:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943062656:12345-192.168.206.16@tcp:1:lfs.0 Request processed in 25976us (27094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781993.887791:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:3.0:1787781993.892486:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.892575:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943063168 00000100:00100000:2.0:1787781993.892584:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943063168 00000100:00100000:2.0:1787781993.892736:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:2.0:1787781993.892746:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+47:12480:x1874624943063168:12345-192.168.206.16@tcp:35:lfs.0 00000004:00010000:2.0:1787781993.892806:0:14286:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cc6 expref: 47 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781993.892985:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787781993.893016:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787781993.893601:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787781993.893828:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.893844:0:14286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 51 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.893854:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.893907:0:14286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 51 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.893933:0:14286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 51 pid: 6532 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.893945:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14286:1874624963041792:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781993.894082:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781993.899975:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.900086:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14286:1874624963041792:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781993.900370:0:14286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.900417:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943063296 00000100:00100000:0.0:1787781993.900423:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943063296 00010000:00010000:0.0:1787781993.900455:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 52 pid: 6532 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.900527:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 97 00000100:00100000:0.0:1787781993.900593:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+52:2408:x1874624943063296:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781993.900639:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781993.900646:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 52 pid: 6532 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900658:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 52 pid: 6532 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900679:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c1506419d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ca3 expref: 52 pid: 6532 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900693:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:0.0:1787781993.900698:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900707:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900714:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.900731:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781993.900780:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+51:2408:x1874624943063296:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 189us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781993.900787:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 97 00010000:00010000:1.0:1787781993.900829:0:14286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.900842:0:14286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781993.900965:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1787781993.901060:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787781993.901160:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963041920:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787781993.901204:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781993.901228:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781993.901278:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963041920 00000100:00100000:3.0:1787781993.901283:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963041920 00000100:00100000:3.0:1787781993.901414:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787781993.901423:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14286:x1874624963041920:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787781993.901522:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14286:x1874624963041920:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.901529:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787781993.901561:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963041920:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787781993.901690:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787781993.901732:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ffcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963042048:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787781993.901762:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781993.901779:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67d99180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781993.901804:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963042048 00000100:00100000:3.0:1787781993.901808:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963042048 00000100:00100000:3.0:1787781993.901832:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787781993.901838:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14286:x1874624963042048:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787781993.902126:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14286:x1874624963042048:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 287us (362us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787781993.902143:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787781993.902665:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ffcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14286:1874624963042048:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787781993.902721:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787781993.902760:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902769:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902776:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902783:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781993.902787:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902793:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902809:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:2.0:1787781993.902819:0:14286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787781993.902824:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.902831:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c150641f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787781993.902936:0:14286:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787781993.903002:0:14286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787781993.903016:0:14286:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430984408033ns, next at 431984404585ns, rc = 0 00000001:00080000:2.0:1787781993.903023:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787781993.903047:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993d67c66300) 00010000:00010000:2.0:1787781993.903050:0:14286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787781993.903056:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbc00/0xc6d6745c150641e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cc6 expref: 55 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.903178:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:12480:x1874624943063168:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 10432us (10700us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787781993.903187:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 56 00000020:00080000:2.0:1787781993.903191:0:14286:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787781993.904280:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781993.907977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781993.910042:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943063424 00000100:00100000:1.0:1787781993.910056:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943063424 00000100:00100000:1.0:1787781993.910866:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 219 00000100:00100000:1.0:1787781993.910881:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+54:12480:x1874624943063424:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.910904:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.910941:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150641ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.911002:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150641ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ccd expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.911016:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150641ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ccd expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.911036:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781993.911039:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781993.911043:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfba00, rc 0) 00000100:00100000:1.0:1787781993.911121:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:12480:x1874624943063424:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 245us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.911145:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 219 00000100:00100000:3.0:1787781993.919523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781993.919739:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943063680 00000100:00100000:2.0:1787781993.919748:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943063680 00000100:00100000:2.0:1787781993.919809:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:2.0:1787781993.919817:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+55:12480:x1874624943063680:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781993.920055:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:12480:x1874624943063680:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 237us (541us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787781993.920063:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:3.0:1787781994.017483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.017780:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943063808 00000100:00100000:2.0:1787781994.017791:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943063808 00000100:00100000:2.0:1787781994.017867:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 220 00000100:00100000:2.0:1787781994.017877:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:12491:x1874624943063808:12345-192.168.206.16@tcp:34:lfs.0 00010000:00010000:2.0:1787781994.017970:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.017988:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018002:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018014:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018022:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018028:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018114:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018123:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018130:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781994.018177:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018205:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018212:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018220:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018226:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.018231:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018240:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018254:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781994.018258:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.018263:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018269:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018281:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018287:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018292:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018304:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.018307:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018314:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018322:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:2.0:1787781994.018324:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.018327:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018333:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506420d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018342:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018349:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018355:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018361:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.018364:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018369:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018388:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.018390:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.018393:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.018399:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.018487:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:12491:x1874624943063808:12345-192.168.206.16@tcp:34:lfs.0 Request processed in 610us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.018497:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 220 00000100:00100000:0.0:1787781994.081818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.082228:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064064 00000100:00100000:2.0:1787781994.082238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064064 00000100:00100000:2.0:1787781994.082303:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 221 00000100:00100000:2.0:1787781994.082313:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+56:12494:x1874624943064064:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.082333:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.082352:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506421b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cd4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082423:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082436:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082447:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082458:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082490:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082497:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082647:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082656:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082663:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.082672:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781994.082743:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082751:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082757:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082762:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.082766:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082773:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082794:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781994.082797:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.082801:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082807:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064222 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082818:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082824:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082830:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082836:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.082839:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082845:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082851:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:2.0:1787781994.082854:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.082857:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082863:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082922:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c1506421b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cd4 expref: 59 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082937:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cd4 expref: 58 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.082944:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.082946:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.082949:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4200, rc 0) 00000100:00100000:2.0:1787781994.083013:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12494:x1874624943064064:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 701us (1204us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787781994.083020:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 221 00000100:00100000:3.0:1787781994.088326:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.088414:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064192 00000100:00100000:1.0:1787781994.088422:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064192 00000100:00100000:1.0:1787781994.088470:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 222 00000100:00100000:1.0:1787781994.088479:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12494:x1874624943064192:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:1.0:1787781994.088543:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088564:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088577:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088649:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088656:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088663:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088669:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfae00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781994.088673:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088680:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088691:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781994.088707:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781994.088712:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.088718:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506423e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.088770:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12494:x1874624943064192:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 292us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.088777:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 222 00000100:00100000:3.0:1787781994.092361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.092647:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064448 00000100:00100000:2.0:1787781994.092658:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064448 00000100:00100000:2.0:1787781994.092719:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:2.0:1787781994.092729:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+58:12494:x1874624943064448:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787781994.093127:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12494:x1874624943064448:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 399us (774us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787781994.093136:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:0.0:1787781994.221299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.221400:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064704 00000100:00100000:2.0:1787781994.221410:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064704 00000100:00100000:2.0:1787781994.221480:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 223 00000100:00100000:2.0:1787781994.221489:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+59:12504:x1874624943064704:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787781994.221513:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.221516:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787781994.221558:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150641c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cb8 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.221577:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781994.221582:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781994.221786:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064245 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cdb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.221896:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c1506424c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.221920:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c1506424c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.221930:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c1506424c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.221941:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781994.222040:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064245 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cdb expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.222055:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c1506424c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cdb expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.222063:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.222066:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.222068:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5000, rc 0) 00000100:00100000:2.0:1787781994.222134:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:12504:x1874624943064704:12345-192.168.206.16@tcp:101:bash.0 Request processed in 646us (844us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787781994.222140:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 223 00000100:00100000:3.0:1787781994.227693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.227825:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064832 00000100:00100000:1.0:1787781994.227834:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064832 00000100:00100000:1.0:1787781994.227890:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 224 00000100:00100000:1.0:1787781994.227900:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:12504:x1874624943064832:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781994.227932:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.227952:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506425a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ce2 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.227984:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.227999:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.228010:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.228123:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506425a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 62 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.228153:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 61 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.228161:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781994.228164:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781994.228167:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa600, rc 0) 00000100:00100000:1.0:1787781994.228230:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:12504:x1874624943064832:12345-192.168.206.16@tcp:101:bash.0 Request processed in 332us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.228237:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 224 00000100:00100000:0.0:1787781994.231794:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.232272:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943064960 00000100:00100000:3.0:1787781994.232281:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943064960 00000100:00100000:3.0:1787781994.232447:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:3.0:1787781994.232459:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+61:2409:x1874624943064960:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.232473:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.232498:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c1506424c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cdb expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.232516:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781994.232521:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781994.232577:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:2409:x1874624943064960:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 120us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.232584:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:0.0:1787781994.234561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.234775:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065216 00000100:00100000:2.0:1787781994.234784:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065216 00000100:00100000:2.0:1787781994.234900:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 225 00000100:00100000:2.0:1787781994.234920:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d03c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+60:12504:x1874624943065216:12345-192.168.206.16@tcp:36:bash.0 00010000:00010000:2.0:1787781994.234970:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.234994:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cd4 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.235010:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.235015:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781994.235254:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.235267:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.235276:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781994.235315:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1787781994.235337:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d011ee7a reply state 000000008157774c transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.235348:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.235354:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.235356:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781994.235451:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781994.235725:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d03c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:12504:x1874624943065216:12345-192.168.206.16@tcp:36:bash.0 Request processed in 816us (1170us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787781994.235745:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 225 00000020:00080000:2.0:1787781994.235749:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787781994.243184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.245176:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065344 00000100:00100000:1.0:1787781994.245191:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065344 00000100:00100000:1.0:1787781994.245271:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 226 00000100:00100000:1.0:1787781994.245281:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+62:12504:x1874624943065344:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:1.0:1787781994.245306:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.245328:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506426f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ce9 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245419:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245434:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245445:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781994.245474:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787781994.245492:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781994.245515:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245541:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c1506426f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 64 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245556:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 63 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.245565:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781994.245568:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781994.245571:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa000, rc 0) 00000100:00100000:1.0:1787781994.245668:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12504:x1874624943065344:12345-192.168.206.16@tcp:101:bash.0 Request processed in 387us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.245676:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 226 00000100:00100000:0.0:1787781994.248788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.248871:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065600 00000100:00100000:3.0:1787781994.248881:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065600 00000100:00100000:3.0:1787781994.248944:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:3.0:1787781994.248954:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+63:12504:x1874624943065600:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:3.0:1787781994.249199:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+64:12504:x1874624943065600:12345-192.168.206.16@tcp:35:bash.0 Request processed in 246us (419us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787781994.249208:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:0.0:1787781994.343921:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.344717:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065728 00000100:00100000:1.0:1787781994.344733:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065728 00000100:00100000:1.0:1787781994.344817:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 227 00000100:00100000:1.0:1787781994.344828:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+64:12510:x1874624943065728:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:1.0:1787781994.344855:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.344880:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c1506427d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cf0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.344963:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.344980:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.345017:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781994.345073:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787781994.345077:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781994.345100:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.345127:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb800/0xc6d6745c1506427d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf0 expref: 66 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.345150:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf0 expref: 65 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.345160:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781994.345163:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781994.345167:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:1.0:1787781994.345344:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943065728:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 517us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.345352:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 227 00000100:00100000:1.0:1787781994.358231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.358516:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065856 00000100:00100000:2.0:1787781994.358528:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065856 00000100:00100000:2.0:1787781994.358591:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 228 00000100:00100000:2.0:1787781994.358603:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943065856:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.358686:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.358710:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506428b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cf7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358780:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358794:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358806:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358819:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358827:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.358834:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359114:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359148:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359156:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.359202:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787781994.359207:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781994.359227:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359239:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359261:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359268:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359275:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359281:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.359284:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359292:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359304:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781994.359308:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.359332:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359339:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c15064292 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359353:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359360:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359366:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359371:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.359374:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359380:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359388:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:2.0:1787781994.359390:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.359393:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359399:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359427:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c1506428b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf7 expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359455:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf7 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.359462:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.359465:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.359467:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4400, rc 0) 00000100:00100000:2.0:1787781994.359523:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12510:x1874624943065856:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 922us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.359531:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 228 00000100:00100000:0.0:1787781994.365050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.366801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943065984 00000100:00100000:2.0:1787781994.366815:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943065984 00000100:00100000:2.0:1787781994.367133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:2.0:1787781994.367146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:2408:x1874624943065984:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781994.367164:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.367190:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf7 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.367211:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.367216:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781994.370154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.370440:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943066240 00000100:00100000:3.0:1787781994.370454:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943066240 00000100:00100000:3.0:1787781994.370521:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 229 00000100:00100000:3.0:1787781994.370531:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12510:x1874624943066240:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781994.370551:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781994.370572:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83cfe expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.371071:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.371088:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.371099:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.371136:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.371150:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.371163:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963042176:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787781994.373990:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67d99300 going to sleep for 11 seconds 00000100:00100000:2.0:1787781994.375994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:2408:x1874624943065984:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 8839us (10940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.376011:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:1.0:1787781994.376543:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.377547:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874624963042176:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787781994.377576:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.382006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943066368 00000100:00100000:2.0:1787781994.382019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943066368 00010000:00010000:2.0:1787781994.382068:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.382201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 98 00000100:00100000:2.0:1787781994.382211:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:2409:x1874624943066368:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781994.382226:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.382239:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382252:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382274:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c15064276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce9 expref: 67 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382291:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.382296:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382305:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382313:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.382351:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781994.382433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:2409:x1874624943066368:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 223us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.382441:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 98 00010000:00010000:1.0:1787781994.382628:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.382637:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781994.382675:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787781994.382824:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 67 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.382840:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 66 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.382847:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781994.382849:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787781994.382851:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705a00, rc 0) 00000100:00100000:1.0:1787781994.382880:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12510:x1874624943066240:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 12352us (12736us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787781994.382887:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 229 00000100:00100000:0.0:1787781994.386475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.386598:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943066624 00000100:00100000:2.0:1787781994.386663:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943066624 00000100:00100000:2.0:1787781994.386718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787781994.386729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12510:x1874624943066624:12345-192.168.206.16@tcp:103:lfs.0 00010000:00010000:2.0:1787781994.386745:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.386785:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150641ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ccd expref: 66 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.386804:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.386810:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781994.386861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943066624:12345-192.168.206.16@tcp:103:lfs.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.386869:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:0.0:1787781994.391299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.391475:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943066752 00000100:00100000:1.0:1787781994.391484:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943066752 00000100:00100000:1.0:1787781994.391538:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 230 00000100:00100000:1.0:1787781994.391548:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943066752:12345-192.168.206.16@tcp:58:lfs.0 00010000:00010000:1.0:1787781994.391676:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.391693:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.391705:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781994.391874:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787781994.392149:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943066752:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 601us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.392158:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 230 00000100:00100000:1.0:1787781994.397902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.401598:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943066880 00000100:00100000:2.0:1787781994.401632:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943066880 00000100:00100000:2.0:1787781994.401710:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 231 00000100:00100000:2.0:1787781994.401721:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+65:12510:x1874624943066880:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.401741:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.401774:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d05 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401829:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401841:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401862:0:6533:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401894:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401923:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.401927:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.401931:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.401940:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4400, rc 0) 00000100:00100000:2.0:1787781994.401999:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12510:x1874624943066880:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 280us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.402008:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 231 00000040:00080000:2.0:1787781994.502344:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781994.502354:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781994.502383:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787781994.502393:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781994.502719:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963042304:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781994.502960:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781994.513529:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963042304:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781994.514410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.514690:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943067008 00000100:00100000:2.0:1787781994.514698:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943067008 00000100:00100000:2.0:1787781994.514857:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 232 00000100:00100000:2.0:1787781994.514868:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12511:x1874624943067008:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781994.514896:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781994.515002:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12511:x1874624943067008:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 136us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.524821:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.525462:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943067136 00000100:00100000:3.0:1787781994.525475:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943067136 00000100:00100000:3.0:1787781994.525691:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 233 00000100:00100000:3.0:1787781994.525703:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067136:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787781994.525773:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525789:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525800:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525816:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525823:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525830:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525854:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525863:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525870:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781994.525945:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787781994.525950:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787781994.525963:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525974:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525980:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525987:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.525993:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.525997:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526004:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526016:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:3.0:1787781994.526020:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.526025:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526031:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704c00/0xc6d6745c150642ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526045:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526061:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526067:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526072:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.526075:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526081:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526090:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff993d67c66900) 00010000:00010000:3.0:1787781994.526092:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.526095:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526101:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c150642d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526115:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526120:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526125:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526130:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.526138:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526144:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526152:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781994.526155:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.526158:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.526164:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150642d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.526241:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067136:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 Request processed in 540us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.526248:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 233 00000100:00100000:2.0:1787781994.527034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 232 00000100:00100000:0.0:1787781994.537480:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.537577:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943067392 00000100:00100000:1.0:1787781994.537587:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943067392 00000100:00100000:1.0:1787781994.537681:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 234 00000100:00100000:1.0:1787781994.537691:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+66:12511:x1874624943067392:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.537712:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.537734:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150642df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d0c expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.537840:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.537864:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.537876:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781994.537887:0:10060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787781994.537972:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.537980:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.537987:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538009:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781994.538014:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538022:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538035:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787781994.538038:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781994.538043:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538050:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538090:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150642df lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d0c expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538101:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:1.0:1787781994.538103:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781994.538107:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150642df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d0c expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.538117:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfba00, rc 0) 00000100:00100000:1.0:1787781994.538167:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067392:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 477us (695us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1787781994.538174:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 234 00000100:00100000:0.0:1787781994.551432:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.554140:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943067520 00000100:00100000:2.0:1787781994.554156:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943067520 00000100:00100000:2.0:1787781994.554237:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 235 00000100:00100000:2.0:1787781994.554248:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067520:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781994.554284:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781994.554410:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067520:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 163us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.554430:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 235 00000100:00100000:0.0:1787781994.561725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.561822:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943067776 00000100:00100000:1.0:1787781994.561845:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943067776 00000100:00100000:1.0:1787781994.561916:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 236 00000100:00100000:1.0:1787781994.561927:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943067776:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.561947:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.561950:0:10060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787781994.561976:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c15064284 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cf0 expref: 67 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.561995:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787781994.561999:0:10060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781994.562010:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150642f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d13 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781994.562359:0:10060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787781994.562491:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.562505:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.562515:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.562561:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c150642f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d13 expref: 69 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.562575:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d13 expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.562594:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526c00) 00010000:00010000:1.0:1787781994.562597:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781994.562599:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa000, rc 0) 00000100:00100000:1.0:1787781994.562722:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:12511:x1874624943067776:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 797us (1006us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787781994.562729:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 236 00010000:00010000:2.0:1787781994.566704:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781994.569973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.570148:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068032 00000100:00100000:3.0:1787781994.570159:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068032 00000100:00100000:3.0:1787781994.570358:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 237 00000100:00100000:3.0:1787781994.570370:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:12511:x1874624943068032:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781994.570429:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.570454:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa000/0xc6d6745c150642fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d13 expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.570483:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526c00) 00010000:00010000:3.0:1787781994.570493:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781994.570513:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.570544:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.570554:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572392:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572414:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572426:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572490:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572497:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572504:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572509:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.572513:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572521:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572531:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:3.0:1787781994.572547:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.572552:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572557:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c15064309 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572574:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572580:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572585:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572590:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.572593:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572598:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572621:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x24056713 (ffff993d67c66900) 00010000:00010000:3.0:1787781994.572625:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.572628:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.572634:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064310 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24056713 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.572746:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943068032:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 2376us (2780us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787781994.572763:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 237 00000100:00100000:0.0:1787781994.578884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.579100:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068160 00000100:00100000:1.0:1787781994.579110:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068160 00000100:00100000:1.0:1787781994.579168:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 238 00000100:00100000:1.0:1787781994.579179:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+67:12511:x1874624943068160:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.579199:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.579236:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15064317 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d1a expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579271:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579286:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579297:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579404:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15064317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 69 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579422:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 68 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.579447:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:1.0:1787781994.579450:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781994.579453:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:1.0:1787781994.579503:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:12511:x1874624943068160:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 326us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.579511:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 238 00000100:00100000:0.0:1787781994.585455:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.585563:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068416 00000100:00100000:2.0:1787781994.585573:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068416 00000100:00100000:2.0:1787781994.585667:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 239 00000100:00100000:2.0:1787781994.585678:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+68:12511:x1874624943068416:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787781994.585756:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.585773:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.585785:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781994.585947:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787781994.585957:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431667348958ns, next at 432667346593ns, rc = 0 00000004:00010000:2.0:1787781994.586004:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7a32369 reply state 000000006d14c5a2 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.586041:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.586049:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:2.0:1787781994.586052:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787781994.586055:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781994.586145:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+70:12511:x1874624943068416:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 469us (698us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787781994.586153:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 239 00000100:00100000:0.0:1787781994.591704:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.592800:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068544 00000100:00100000:1.0:1787781994.592811:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068544 00000100:00100000:1.0:1787781994.592875:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 240 00000100:00100000:1.0:1787781994.592884:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+70:12511:x1874624943068544:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.592916:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.592936:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d21 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.592997:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 71 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.593012:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 71 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.593030:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:1.0:1787781994.593033:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781994.593037:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfbe00, rc 0) 00000100:00100000:1.0:1787781994.593104:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+71:12511:x1874624943068544:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 221us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.593131:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 240 00000100:00100000:0.0:1787781994.602384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.602543:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068672 00000100:00100000:1.0:1787781994.602552:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068672 00000100:00100000:1.0:1787781994.602734:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00100000:1.0:1787781994.602746:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943068672:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787781994.602985:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943068672:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 241us (610us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787781994.602993:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 70 00000100:00080000:2.0:1787781994.603052:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781994.607134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.607246:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943068928 00000100:00100000:2.0:1787781994.607255:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943068928 00000100:00100000:2.0:1787781994.607315:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:2.0:1787781994.607325:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+71:12511:x1874624943068928:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781994.607554:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+72:12511:x1874624943068928:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 229us (490us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787781994.607572:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:0.0:1787781994.612147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.612288:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069184 00000100:00100000:2.0:1787781994.612297:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069184 00000100:00100000:2.0:1787781994.612355:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 241 00000100:00100000:2.0:1787781994.612372:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+72:12511:x1874624943069184:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787781994.612643:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+72:12511:x1874624943069184:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 234us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.612651:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 241 00000100:00100000:0.0:1787781994.616434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.616598:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069312 00000100:00100000:1.0:1787781994.616636:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069312 00000100:00100000:1.0:1787781994.616758:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 242 00000100:00100000:1.0:1787781994.616768:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+72:12511:x1874624943069312:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.616801:0:10060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.616821:0:10060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15064333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d28 expref: -99 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.616881:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.616894:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.616914:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781994.616953:0:10060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787781994.616969:0:10060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.617008:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfba00/0xc6d6745c15064333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d28 expref: 74 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.617024:0:10060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d28 expref: 73 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.617033:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:1.0:1787781994.617036:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781994.617039:0:10060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787781994.617124:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+73:12511:x1874624943069312:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 357us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.617131:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 242 00000100:00100000:0.0:1787781994.625711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.626109:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069440 00000100:00100000:3.0:1787781994.626118:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069440 00000100:00100000:3.0:1787781994.626222:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 71 00000100:00100000:3.0:1787781994.626232:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+10:2409:x1874624943069440:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781994.626248:0:13830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781994.626266:0:13830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d2f expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781994.626296:0:13830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f636a, blocks: 0x0 00010000:00010000:3.0:1787781994.626314:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1787781994.626319:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781994.626328:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 11 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.626348:0:13830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 11 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.626415:0:13830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705200, rc 0) 00000100:00100000:3.0:1787781994.626547:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:2409:x1874624943069440:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 316us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.626555:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 71 00000100:00100000:0.0:1787781994.630224:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.630394:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069696 00000100:00100000:3.0:1787781994.630403:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069696 00000100:00100000:3.0:1787781994.630501:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 243 00000100:00100000:3.0:1787781994.630512:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+73:12511:x1874624943069696:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781994.630650:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+73:12511:x1874624943069696:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 140us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.630659:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 243 00000100:00100000:0.0:1787781994.635364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.635737:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069824 00000100:00100000:3.0:1787781994.635747:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069824 00000100:00100000:0.0:1787781994.635981:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:0.0:1787781994.635992:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+11:12511:x1874624943069824:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781994.636013:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781994.636032:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d36 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.636095:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 12 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.636104:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781994.636108:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781994.636114:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.636145:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 12 pid: 13830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.636159:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 12 pid: 13830 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.636173:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1874624963042432:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781994.636270:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.639758:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.639898:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943069952 00000100:00100000:3.0:1787781994.639917:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943069952 00010000:00010000:3.0:1787781994.639959:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 13 pid: 13830 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.640005:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 99 00000100:00100000:3.0:1787781994.640014:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2409:x1874624943069952:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.640029:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.640052:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 13 pid: 13830 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.640066:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 13 pid: 13830 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.640094:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781994.640099:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781994.640108:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 13 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.640120:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 13 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.640182:0:9533:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 13 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.640197:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9533:1874624963042560:192.168.206.16@tcp:105: 00000100:00100000:3.0:1787781994.640281:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67d99300 going to sleep for 11 seconds 00010000:00010000:2.0:1787781994.640702:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca0bc4f/0xc6d6745c15064341 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d2f expref: 13 pid: 13830 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.640731:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1874624963042432:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781994.640756:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.640766:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:2.0:1787781994.640798:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:12511:x1874624943069824:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 4808us (5444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.640806:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:1.0:1787781994.650726:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.650873:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070080 00000100:00100000:0.0:1787781994.650882:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070080 00002000:00100000:0.0:1787781994.650941:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff993d49161680 x1874624943070080/t0(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:140/0 lens 504/0 e 0 to 0 dl 1787782005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781994.650953:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d49161680 with x1874624943070080 ext(0->12) 00002000:00010000:0.0:1787781994.650959:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d49161680 00000100:00100000:0.0:1787781994.650991:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:0.0:1787781994.651016:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+12:2407:x1874624943070080:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787781994.651508:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9533:1874624963042560:192.168.206.16@tcp:105: 00010000:00010000:3.0:1787781994.651544:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781994.651596:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+14:2409:x1874624943069952:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 11582us (11847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.651634:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 99 00000100:00100000:1.0:1787781994.652375:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2407:x1874624943070080:12345-192.168.206.16@tcp:4:lhsmtool_posix.0 Request processed in 1358us (1655us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787781994.652384:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00002000:00100000:1.0:1787781994.652394:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff993d49161680 x1874624943070080/t4294967321(0) o4->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:140/0 lens 504/448 e 0 to 0 dl 1787782005 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781994.652403:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d49161680 with x1874624943070080 ext(0->12) 00002000:00010000:1.0:1787781994.652408:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d49161680 00000100:00100000:1.0:1787781994.655400:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.655593:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070208 00000100:00100000:3.0:1787781994.655603:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070208 00000100:00100000:3.0:1787781994.655696:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 244 00000100:00100000:3.0:1787781994.655706:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+73:12511:x1874624943070208:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787781994.659163:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1787781994.659178:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787781994.659213:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787781994.659231:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d80ac6240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787781994.659236:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d4721b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d80ac6000 00000020:00080000:2.0:1787781994.659239:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d5037bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993c43426e00 00000004:00080000:2.0:1787781994.659262:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787781994.659283:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d67ff7240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787781994.659286:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d58f0e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d67ff7180 00000020:00080000:2.0:1787781994.659288:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d58f0e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993c43fb8000 00000020:00080000:2.0:1787781994.659307:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787781994.659370:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787781994.659549:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963042688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787781994.659637:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781994.659723:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963042688 00000100:00100000:1.0:1787781994.659729:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963042688 00000100:00100000:1.0:1787781994.659775:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787781994.659784:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3660:x1874624963042688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787781994.659812:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1787781994.659839:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6369, atime: 0x6a8f6369, ctime: 0x6a8f6369, blocks: 0x8 00010000:00010000:1.0:1787781994.659847:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.659864:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1787781994.659868:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781994.659874:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.659890:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.659900:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.659920:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.659937:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787781994.660048:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3660:x1874624963042688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 264us (410us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787781994.660055:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1787781994.660085:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781994.660095:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.660114:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfae00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787781994.660118:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.660128:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.660143:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.660150:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c1506434f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.660166:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781994.660168:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781994.660170:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787781994.660195:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993d49161e00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787781994.660201:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963042688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787781994.662538:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963042944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787781994.662637:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781994.662675:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781994.662681:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963042816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781994.662702:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781994.663162:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12511:x1874624943070208:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 Request processed in 7455us (7768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.663173:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 244 00000100:00100000:2.0:1787781994.665703:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963042944 00000100:00100000:2.0:1787781994.665718:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963042944 00000100:00100000:2.0:1787781994.665789:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963042816 00000100:00100000:2.0:1787781994.665792:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963042816 00000100:00100000:2.0:1787781994.665816:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787781994.665825:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3658:x1874624963042944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787781994.665968:0:8638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787781994.665972:0:8638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787781994 00002000:00010000:2.0:1787781994.665975:0:8638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787781994.665978:0:8638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787781994 -> 1787781994 00002000:00010000:2.0:1787781994.665980:0:8638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787781994.666053:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3658:x1874624963042944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (3416us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787781994.666060:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787781994.666084:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787781994.666091:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3658:x1874624963042816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787781994.666106:0:8638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787781994.666122:0:8638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.666142:0:8638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 12 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.666169:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787781994.666174:0:8638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781994.666179:0:8638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.666212:0:8638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 12 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.666225:0:8638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 12 pid: 8638 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.666238:0:8638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963043072:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781994.666300:0:8638:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d413776c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787781994.666339:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c437530c0/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787781994.666345:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963042944:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1787781994.666670:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787781994.668247:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668262:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668270:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668276:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.668281:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668306:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668323:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff993d67c66f00) 00010000:00010000:3.0:1787781994.668326:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.668331:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668338:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c1506404d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668390:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668397:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668403:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668408:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.668411:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668418:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.668426:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff993c42526d00) 00010000:00010000:3.0:1787781994.668428:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.668431:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672036:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150640f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672083:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672091:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672099:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672106:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.672110:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672119:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672134:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:3.0:1787781994.672138:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.672142:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672148:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c15064173 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672177:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672184:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672200:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672206:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.672210:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672216:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672226:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c42526b00) 00010000:00010000:3.0:1787781994.672229:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.672231:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672237:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064196 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672254:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672260:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672266:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672270:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.672273:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672288:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672296:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781994.672298:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.672301:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672307:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c15064268 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672321:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672327:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672332:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672337:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781994.672340:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672346:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672354:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:3.0:1787781994.672356:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787781994.672365:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.672383:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c15064325 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.672454:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.675056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.675272:0:8638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8638:1874624963043072:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781994.675298:0:8638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.676341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070464 00000100:00100000:3.0:1787781994.676353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070464 00010000:00010000:3.0:1787781994.676396:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 13 pid: 8638 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.676432:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 100 00000100:00100000:3.0:1787781994.676454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2408:x1874624943070464:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.676470:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.676476:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 13 pid: 8638 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.676489:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 13 pid: 8638 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.676518:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064103 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c8e expref: 13 pid: 8638 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.676536:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781994.676540:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781994.676546:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.676556:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.676622:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070336 00010000:00010000:3.0:1787781994.676627:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781994.676627:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070336 00000100:00100000:0.0:1787781994.676658:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:0.0:1787781994.676664:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2408:x1874624943070336:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787781994.676677:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+13:2408:x1874624943070464:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 237us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.676684:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 100 00010000:00010000:1.0:1787781994.677490:0:8638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.677505:0:8638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.677522:0:8638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.677530:0:8638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.677557:0:8638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787781994.678024:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781994.678031:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.678039:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781994.678044:0:10349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.678052:0:10349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.678068:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.678077:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9a8f03/0xc6d6745c15064356 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.678095:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781994.678105:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781994.678106:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781994.680308:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3658:x1874624963042816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14209us (17597us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787781994.680322:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1787781994.680478:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993c43750000/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787781994.680486:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963042816:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787781994.681710:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787781994.681724:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787781994.683979:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943070336:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 Request processed in 7304us (11519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.683993:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 76 00000100:00100000:1.0:1787781994.689427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.689494:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070720 00000100:00100000:2.0:1787781994.689504:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070720 00000100:00100000:2.0:1787781994.689670:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 245 00000100:00100000:2.0:1787781994.689681:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12511:x1874624943070720:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787781994.689733:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.689760:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c1506433a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d28 expref: 21 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.690193:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:2.0:1787781994.690200:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781994.690234:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.690248:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.690258:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781994.690373:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5143479 reply state 0000000076315f8b transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.690386:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.690392:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:2.0:1787781994.690395:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787781994.690398:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781994.690488:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12511:x1874624943070720:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 808us (1070us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787781994.690514:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 245 00000100:00100000:2.0:1787781994.693667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.693757:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943070848 00000100:00100000:1.0:1787781994.693766:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943070848 00000100:00100000:1.0:1787781994.693830:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 77 00000100:00100000:1.0:1787781994.693839:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2409:x1874624943070848:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787781994.693991:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787781994.693994:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787781994 -> 1787781993 00002000:00010000:1.0:1787781994.693997:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787781993 00002000:00010000:1.0:1787781994.693999:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787781994 -> 1787781993 00002000:00010000:1.0:1787781994.694001:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787781994.694059:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943070848:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 220us (400us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787781994.694067:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 77 00000100:00100000:0.0:1787781994.700790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781994.700987:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071104 00000100:00100000:1.0:1787781994.701010:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071104 00000100:00100000:1.0:1787781994.701069:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 246 00000100:00100000:1.0:1787781994.701079:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:12511:x1874624943071104:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.701141:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.701158:0:10060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 22 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.701167:0:10060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.701200:0:10060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 22 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.701215:0:10060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.701228:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963043200:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787781994.701303:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781994.705860:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.706071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071232 00000100:00100000:0.0:1787781994.706080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071232 00010000:00010000:0.0:1787781994.706122:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 23 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.706162:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 101 00000100:00100000:0.0:1787781994.706172:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:2409:x1874624943071232:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781994.706188:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781994.706195:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 23 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.706208:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 23 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.706229:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:0.0:1787781994.706234:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.706244:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.706251:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.706291:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781994.706349:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+23:2409:x1874624943071232:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 178us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.706358:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 101 00010000:00010000:1.0:1787781994.707211:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa200/0xc6d6745c1506431e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d1a expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.707231:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10060:1874624963043200:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787781994.707251:0:10060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707259:0:10060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707276:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707314:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707320:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707326:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707332:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfae00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787781994.707336:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707342:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707354:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:1.0:1787781994.707357:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787781994.707361:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.707368:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfae00/0xc6d6745c15064364 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.707417:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12511:x1874624943071104:12345-192.168.206.16@tcp:55:lhsmtool_posix.0 Request processed in 6339us (6644us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787781994.707426:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 246 00000100:00100000:2.0:1787781994.711472:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.711960:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071360 00000100:00100000:0.0:1787781994.711969:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071360 00000100:00100000:0.0:1787781994.712050:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 78 00000100:00100000:0.0:1787781994.712059:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2408:x1874624943071360:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787781994.712102:0:13830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.712132:0:13830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.712141:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781994.712145:0:13830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781994.712150:0:13830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.712181:0:13830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.712196:0:13830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 8 pid: 8447 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.712211:0:13830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13830:1874624963043328:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787781994.712301:0:13830:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d772fd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.716673:0:13830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13830:1874624963043328:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781994.716704:0:13830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.721578:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.721846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071488 00000100:00100000:3.0:1787781994.721855:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071488 00010000:00010000:3.0:1787781994.721967:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 9 pid: 8447 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.722009:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 102 00000100:00100000:3.0:1787781994.722021:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+9:2409:x1874624943071488:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.722038:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.722062:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 9 pid: 8447 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.722077:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 9 pid: 8447 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.722101:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1047f/0xc6d6745c15064348 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d36 expref: 9 pid: 8447 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.723086:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781994.723090:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781994.723098:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.723409:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723565:0:13830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.723567:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781994.723575:0:13830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.723720:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2409:x1874624943071488:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 1698us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.723731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 102 00010000:00010000:0.0:1787781994.723779:0:13830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723790:0:13830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723798:0:13830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723868:0:13830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787781994.723872:0:13830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723882:0:13830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723920:0:13830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.723929:0:13830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000473f494a/0xc6d6745c1506436b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.723982:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943071360:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 Request processed in 11922us (12517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.723990:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 78 00000100:00100000:2.0:1787781994.730162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.730267:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071744 00000100:00100000:3.0:1787781994.730277:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071744 00000100:00100000:3.0:1787781994.730338:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 247 00000100:00100000:3.0:1787781994.730348:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:12511:x1874624943071744:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787781994.730432:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.730600:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 21 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.730687:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.730723:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 21 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.730737:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 21 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.730774:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043456:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781994.731234:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67d99300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.735215:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa98000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043456:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781994.735246:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.735659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.735946:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943071872 00000100:00100000:3.0:1787781994.735955:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943071872 00010000:00010000:3.0:1787781994.735997:0:9533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.736083:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 103 00000100:00100000:3.0:1787781994.736093:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:2408:x1874624943071872:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.736772:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.736859:0:9533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736875:0:9533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736899:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa600/0xc6d6745c15064261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ce2 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736932:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781994.736939:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736948:0:9533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736954:0:9533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.736978:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.737016:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781994.737092:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:2408:x1874624943071872:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 1000us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.737100:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 103 00010000:00010000:2.0:1787781994.737311:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737320:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737501:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737512:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737520:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737552:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.737565:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.737591:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043584:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781994.737665:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4355ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.741336:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043584:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787781994.741362:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.743198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.743604:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943072000 00000100:00100000:0.0:1787781994.743644:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943072000 00010000:00010000:0.0:1787781994.743689:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.743729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 104 00000100:00100000:0.0:1787781994.743740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:2408:x1874624943072000:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781994.743754:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781994.743774:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.743958:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.743984:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfbe00/0xc6d6745c1506432c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d21 expref: 22 pid: 10060 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.744001:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:0.0:1787781994.744007:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.744017:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.744025:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.744061:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781994.744128:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:2408:x1874624943072000:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 390us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.744137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 104 00010000:00010000:2.0:1787781994.744646:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.744655:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781994.744759:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787781994.744965:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787781994.745004:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787781994.745084:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963043712:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787781994.745309:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781994.745344:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433600 going to sleep for 11 seconds 00000100:00100000:3.0:1787781994.745413:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963043712 00000100:00100000:3.0:1787781994.745420:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963043712 00000100:00100000:3.0:1787781994.745475:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787781994.745483:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1874624963043712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787781994.745567:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1874624963043712:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.745574:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787781994.745662:0:6533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787781994.745667:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1787781994.745683:0:6533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c437530c0, transno 4294967322 00000100:00100000:2.0:1787781994.745697:0:6533:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff993c43750000 x1874624963042816/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787782010 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781994.745707:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963043712:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787781994.745818:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787781994.745860:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963043840:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787781994.745885:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781994.745920:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d454339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781994.746026:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963043840 00000100:00100000:3.0:1787781994.746031:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963043840 00000100:00100000:3.0:1787781994.746062:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787781994.746069:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6533:x1874624963043840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787781994.746175:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1874624963043840:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (287us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787781994.746182:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787781994.746592:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874624963043840:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787781994.746677:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746686:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746693:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746699:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.746703:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746711:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746726:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:2.0:1787781994.746729:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.746733:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746738:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064379 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746760:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746766:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746770:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746796:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.746798:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746805:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746813:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.746815:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.746821:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746830:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746838:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.746866:0:6533:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.746876:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4a563480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043968:192.168.206.16@tcp:105: 00000100:00100000:2.0:1787781994.746943:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d454339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.751469:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4a563480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874624963043968:192.168.206.16@tcp:105: 00010000:00010000:0.0:1787781994.751501:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751511:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfa400/0xc6d6745c150642bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751564:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751577:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751588:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751599:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751648:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751656:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751661:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781994.751665:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751672:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751683:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:0.0:1787781994.751686:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781994.751690:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751696:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166000/0xc6d6745c15064380 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751714:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751720:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751726:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751732:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781994.751735:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751741:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751750:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:0.0:1787781994.751753:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781994.751756:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.751762:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064372 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.751938:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12511:x1874624943071744:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 21590us (21783us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787781994.751948:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 247 00000020:00080000:0.0:1787781994.751954:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781994.752225:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781994.752231:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781994.752732:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787781994.752741:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781994.754658:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.754807:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943072128 00000100:00100000:0.0:1787781994.754816:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943072128 00000100:00100000:0.0:1787781994.754880:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:0.0:1787781994.754890:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12510:x1874624943072128:12345-192.168.206.16@tcp:49:lfs.0 00000100:00100000:0.0:1787781994.755023:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12510:x1874624943072128:12345-192.168.206.16@tcp:49:lfs.0 Request processed in 134us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.755031:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:1.0:1787781994.760764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.760892:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943072384 00000100:00100000:0.0:1787781994.760901:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943072384 00000100:00100000:0.0:1787781994.760970:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:0.0:1787781994.760981:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12510:x1874624943072384:12345-192.168.206.16@tcp:58:lfs.0 00000040:00080000:0.0:1787781994.761154:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787781994.761231:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12510:x1874624943072384:12345-192.168.206.16@tcp:58:lfs.0 Request processed in 251us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.761240:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 248 00000100:00100000:3.0:1787781994.773009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.773209:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943072640 00000100:00100000:2.0:1787781994.773219:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943072640 00000100:00100000:2.0:1787781994.773281:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:2.0:1787781994.773291:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+24:12511:x1874624943072640:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787781994.773569:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787781994.773599:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787781994.773674:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773689:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773700:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773708:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773714:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773720:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.773745:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787781994.773831:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+26:12511:x1874624943072640:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 540us (829us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787781994.773840:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 62 00000020:00080000:2.0:1787781994.773845:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787781994.774960:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781994.774974:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.775003:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787781994.775007:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.775016:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.775031:0:10348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:3.0:1787781994.775034:0:10348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787781994.775039:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.775046:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4800/0xc6d6745c15064387 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.775061:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781994.775063:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781994.775065:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781994.807535:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781994.807706:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943072768 00000100:00100000:2.0:1787781994.807716:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943072768 00000100:00100000:2.0:1787781994.807802:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:2.0:1787781994.807814:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+26:12513:x1874624943072768:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.807837:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.807857:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506438e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d3d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807932:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807946:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807957:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807981:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807988:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.807995:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.808063:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.808083:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.808091:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.808130:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.808144:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 27 pid: 6532 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.808158:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4a563480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963044096:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787781994.808253:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d454333c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781994.813127:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781994.813216:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073024 00000100:00100000:3.0:1787781994.813225:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073024 00000100:00100000:3.0:1787781994.813286:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:3.0:1787781994.813296:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:6190:x1874624943073024:12345-192.168.206.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787781994.813526:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:6190:x1874624943073024:12345-192.168.206.16@tcp:35:ldlm_bl.0 Request processed in 231us (409us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787781994.813533:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:2.0:1787781994.814760:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4a563480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874624963044096:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787781994.814798:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.817351:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781994.817518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073152 00000100:00100000:0.0:1787781994.817528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073152 00010000:00010000:0.0:1787781994.817568:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 29 pid: 6532 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.817647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 105 00000100:00100000:0.0:1787781994.817658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:2409:x1874624943073152:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781994.817674:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781994.817682:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 29 pid: 6532 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817695:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 29 pid: 6532 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817747:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c150642ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83cfe expref: 29 pid: 6532 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817764:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:0.0:1787781994.817769:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817778:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817952:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.817985:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781994.818039:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:2409:x1874624943073152:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 382us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.818047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 105 00010000:00010000:2.0:1787781994.818982:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.818995:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.819049:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787781994.819054:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787781994.819085:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819100:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819109:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819130:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819137:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819143:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.819147:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819154:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819166:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:2.0:1787781994.819169:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.819173:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819179:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5000/0xc6d6745c15064395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819192:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819198:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819205:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819211:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787781994.819220:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819226:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819234:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff993c436a3000) 00010000:00010000:2.0:1787781994.819237:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.819239:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819245:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5c00/0xc6d6745c1506439c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819283:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5400/0xc6d6745c1506438e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d3d expref: 28 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819297:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d3d expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.819305:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781994.819307:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.819310:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4200, rc 0) 00000100:00100000:2.0:1787781994.819378:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12513:x1874624943072768:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 11566us (11852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.819386:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 249 00000100:00100000:2.0:1787781995.013879:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781995.013914:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963044224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787781995.013979:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781995.014168:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044224 00000100:00100000:0.0:1787781995.014175:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044224 00000100:00100000:0.0:1787781995.014225:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787781995.014234:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963044224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787781995.014266:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787781995.014323:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963044224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781995.014330:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787781995.014428:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963044224:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787781995.531376:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787781995.531400:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:2.0:1787781995.590873:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781995.668064:0:14773:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781995.668071:0:14773:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781995.668232:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787781995.668240:0:14773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787781995.782213:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781995.782222:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781995.782258:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787781995.782267:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781995.782389:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963044352:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781995.782634:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781995.795627:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874624963044352:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787781995.797215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781995.801560:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073280 00000100:00100000:0.0:1787781995.801571:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073280 00000100:00100000:0.0:1787781995.801912:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00100000:0.0:1787781995.801923:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12525:x1874624943073280:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787781995.801959:0:6532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787781995.802072:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12525:x1874624943073280:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 151us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781995.802080:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 250 00000100:00080000:2.0:1787781995.802407:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781995.809764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781995.809812:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073536 00000100:00100000:2.0:1787781995.809822:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073536 00000100:00100000:2.0:1787781995.809877:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 251 00000100:00100000:2.0:1787781995.809887:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+27:12525:x1874624943073536:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781995.809917:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.809938:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150643aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.810046:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150643b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.810068:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150643b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.810081:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150643b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.810092:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787781995.810194:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4000/0xc6d6745c150643aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d44 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.810211:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150643b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d44 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.810241:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:2.0:1787781995.810245:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781995.810248:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4e00, rc 0) 00000100:00100000:2.0:1787781995.810303:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:12525:x1874624943073536:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 417us (547us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787781995.810310:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 251 00000100:00100000:0.0:1787781995.814046:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781995.814207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073664 00000100:00100000:3.0:1787781995.814215:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073664 00000100:00100000:3.0:1787781995.814315:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:3.0:1787781995.814325:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:2408:x1874624943073664:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.814341:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.814365:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4e00/0xc6d6745c150643b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d44 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.814384:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781995.814389:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.814442:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:2408:x1874624943073664:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.814450:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:1.0:1787781995.815478:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781995.815585:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943073920 00000100:00100000:0.0:1787781995.815592:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943073920 00000100:00100000:0.0:1787781995.815840:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 252 00000100:00100000:0.0:1787781995.815850:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+28:12525:x1874624943073920:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787781995.815931:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.815951:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.815963:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816144:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816167:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816174:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816180:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787781995.816184:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816191:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816202:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:0.0:1787781995.816205:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781995.816209:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.816216:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c150643bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.816340:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:12525:x1874624943073920:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 490us (864us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787781995.816348:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 252 00000040:00080000:1.0:1787781995.816914:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781995.816920:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781995.818484:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787781995.818499:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781995.819039:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781995.819157:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074176 00000100:00100000:0.0:1787781995.819166:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074176 00000100:00100000:0.0:1787781995.819218:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:0.0:1787781995.819228:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+29:12525:x1874624943074176:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787781995.819560:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:12525:x1874624943074176:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 333us (525us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787781995.819583:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00010000:00010000:1.0:1787781996.613923:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781997.061817:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781997.063078:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963044736:0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.063147:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.063209:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963044608:0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.063223:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044736 00000100:00100000:2.0:1787781997.063230:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044736 00000100:00100000:3.0:1787781997.063253:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781997.063287:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787781997.063298:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.063325:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044608 00000100:00100000:3.0:1787781997.063331:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044608 00000100:00100000:2.0:1787781997.063354:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963044736:12345-0@lo:400:kworker.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.063362:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787781997.063367:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787781997.063376:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963044608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.063406:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963044736:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.063419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963044608:12345-0@lo:400:kworker.0 Request processed in 43us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.063426:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787781997.063458:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963044608:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.064527:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963044864:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.064572:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.064625:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963044480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787781997.064629:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044864 00000100:00100000:2.0:1787781997.064636:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044864 00000100:00100000:3.0:1787781997.064650:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781997.064812:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963045120:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.064843:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.064887:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963044992:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.064922:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.064940:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963045504:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.064960:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.064973:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963046016:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.064991:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.065011:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787781997.065016:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963045376:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065034:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.065048:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963045888:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065066:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.065088:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044992 00000100:00100000:3.0:1787781997.065092:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044992 00000100:00100000:3.0:1787781997.065116:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045376 00000100:00100000:3.0:1787781997.065119:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045376 00000100:00100000:3.0:1787781997.065137:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045888 00000100:00100000:3.0:1787781997.065139:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045888 00000100:00100000:3.0:1787781997.065153:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787781997.065160:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065215:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963044992:12345-0@lo:400:kworker.0 Request processed in 55us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.065222:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787781997.065247:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787781997.065253:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065281:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963045376:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.065287:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787781997.065297:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787781997.065302:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963045888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065324:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963045888:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.065330:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:3.0:1787781997.065359:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fe03c0 x1874624963045376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781997.065370:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963045376:0@lo:400:kworker.0 00010000:00080000:3.0:1787781997.065380:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fe3480 x1874624963045888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781997.065388:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963045888:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065398:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963044992:0@lo:400:kworker.0 00000100:00080000:3.0:1787781997.065437:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787781997.065463:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963045248:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.065503:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963045760:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065522:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.065547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045248 00000100:00100000:3.0:1787781997.065551:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045248 00000100:00100000:3.0:1787781997.065582:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045760 00000100:00100000:3.0:1787781997.065586:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045760 00000100:00100000:3.0:1787781997.065600:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787781997.065624:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963045248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065659:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963045248:12345-0@lo:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.065665:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787781997.065676:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787781997.065683:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963045760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065708:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963045760:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.065714:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:3.0:1787781997.065728:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781997.065746:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963045248:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.065755:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963045760:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067015:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963045632:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067063:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781997.067086:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067105:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781997.067143:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045504 00000100:00100000:1.0:1787781997.067150:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045504 00000100:00100000:1.0:1787781997.067206:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046016 00000100:00100000:1.0:1787781997.067210:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046016 00000100:00100000:1.0:1787781997.067223:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045632 00000100:00100000:1.0:1787781997.067225:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045632 00000100:00100000:1.0:1787781997.067234:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046144 00000100:00100000:1.0:1787781997.067236:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046144 00000100:00100000:1.0:1787781997.067249:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787781997.067255:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067299:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963045504:12345-0@lo:400:kworker.0 Request processed in 43us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.067321:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787781997.067337:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787781997.067342:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963046016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067372:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963046016:12345-0@lo:400:kworker.0 Request processed in 30us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.067378:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787781997.067389:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787781997.067394:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067423:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963045632:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.067429:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787781997.067440:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787781997.067446:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067470:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963046144:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.067476:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787781997.067493:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781997.067497:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781997.067521:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963045504:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067531:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963046016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067558:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963045632:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.067566:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787781997.067571:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1787781997.067592:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43c69e00, transno 4294967308 00000004:00080000:1.0:1787781997.067626:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1787781997.067637:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993d49161e00, transno 4294967311 00000100:00100000:1.0:1787781997.067642:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046144:0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.070991:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963044480 00000100:00100000:2.0:1787781997.071005:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963044480 00000100:00100000:2.0:1787781997.071060:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963045120 00000100:00100000:2.0:1787781997.071064:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963045120 00000100:00100000:2.0:1787781997.071081:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787781997.071091:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624963044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.071219:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787781997.071229:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624963044480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787781997.071256:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787781997.071319:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624963044864:12345-0@lo:400:kworker.0 Request processed in 229us (6747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.071327:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787781997.071345:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787781997.071352:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963045120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.071401:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963045120:12345-0@lo:400:kworker.0 Request processed in 50us (6557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.071408:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787781997.071463:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963045120:0@lo:400:kworker.0 00000100:00100000:3.0:1787781997.071532:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963044480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 305us (6881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.071539:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787781997.072989:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963044864:0@lo:400:kworker.0 00000100:00100000:1.0:1787781997.073018:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963044480:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787781997.560287:0:14824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781997.560295:0:14824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781997.560326:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787781997.560332:0:14824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781997.574787:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781997.574809:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963046272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787781997.574983:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781997.575108:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781997.575118:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963046400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781997.575148:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.575148:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046272 00000100:00100000:0.0:1787781997.575156:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046272 00000100:00100000:0.0:1787781997.575196:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046400 00000100:00100000:0.0:1787781997.575199:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046400 00000100:00100000:0.0:1787781997.575216:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781997.575223:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963046272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787781997.575250:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781997.575304:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963046272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.575312:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781997.575328:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787781997.575334:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963046400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781997.575344:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787781997.575383:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963046400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.575388:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787781997.575456:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963046400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781997.575520:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963046272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787781997.638738:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781997.773955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.774037:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074432 00000100:00100000:3.0:1787781997.774047:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074432 00000100:00100000:3.0:1787781997.774123:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 253 00000100:00100000:3.0:1787781997.774149:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+30:12545:x1874624943074432:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787781997.774175:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781997.774196:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d4b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.774314:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150643cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.774328:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150643cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.774340:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150643cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781997.774351:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787781997.774450:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d4b expref: 33 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.774469:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150643cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d4b expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.774478:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781997.774481:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787781997.774484:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787781997.774545:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:12545:x1874624943074432:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 398us (598us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787781997.774552:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 253 00000100:00080000:1.0:1787781997.774731:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781997.781052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.781184:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074560 00000100:00100000:3.0:1787781997.781193:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074560 00000100:00100000:3.0:1787781997.781262:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 254 00000100:00100000:3.0:1787781997.781273:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:12545:x1874624943074560:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:3.0:1787781997.781334:0:10060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781351:0:10060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781362:0:10060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781394:0:10060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781401:0:10060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781408:0:10060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781413:0:10060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787781997.781417:0:10060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781424:0:10060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781434:0:10060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:3.0:1787781997.781438:0:10060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781997.781442:0:10060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.781458:0:10060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704e00/0xc6d6745c150643db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781997.781992:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+32:12545:x1874624943074560:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 718us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.782001:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 254 00000100:00100000:0.0:1787781997.917274:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787781997.917423:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074688 00000100:00100000:1.0:1787781997.917432:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074688 00000100:00080000:3.0:1787781997.917548:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781997.917590:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 79 00000100:00100000:1.0:1787781997.917600:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943074688:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:1.0:1787781997.917646:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781997.917665:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9952a05/0xc6d6745c150643e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d52 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781997.917691:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f6369, atime: 0x6a8f6369, ctime: 0x6a8f6369, blocks: 0x8 00010000:00010000:1.0:1787781997.917710:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787781997.917714:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781997.917734:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9952a05/0xc6d6745c150643e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d52 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781997.917781:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9952a05/0xc6d6745c150643e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d52 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781997.917794:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa600, rc 0) 00000100:00100000:1.0:1787781997.917850:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2406:x1874624943074688:12345-192.168.206.16@tcp:101:cat.0 Request processed in 251us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.917856:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 79 00000100:00100000:3.0:1787781997.929227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787781997.930914:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074816 00000100:00100000:0.0:1787781997.930927:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074816 00002000:00100000:0.0:1787781997.930988:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff993d7fa99a40 x1874624943074816/t0(0) o3->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1787782008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781997.931000:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa99a40 with x1874624943074816 ext(0->4095) 00002000:00010000:0.0:1787781997.931006:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa99a40 00000100:00100000:0.0:1787781997.931064:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:0.0:1787781997.931073:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2407:x1874624943074816:12345-192.168.206.16@tcp:3:cat.0 00000100:00100000:0.0:1787781997.931257:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+8:2407:x1874624943074816:12345-192.168.206.16@tcp:3:cat.0 Request processed in 183us (2033us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787781997.931266:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00002000:00100000:0.0:1787781997.931273:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff993d7fa99a40 x1874624943074816/t0(0) o3->cd0eda9e-1cb2-4b8a-8952-0f785606e4c5@192.168.206.16@tcp:143/0 lens 488/4536 e 0 to 0 dl 1787782008 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781997.931281:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff993d7fa99a40 with x1874624943074816 ext(0->4095) 00002000:00010000:0.0:1787781997.931284:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff993d7fa99a40 00000100:00100000:3.0:1787781997.971856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.972221:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.972258:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.972292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787781997.972314:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787781997.972386:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075456 00000100:00100000:2.0:1787781997.972396:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075456 00000100:00100000:2.0:1787781997.972449:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075072 00000100:00100000:2.0:1787781997.972451:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075072 00000100:00100000:2.0:1787781997.972465:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075328 00000100:00100000:2.0:1787781997.972466:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075328 00000100:00100000:2.0:1787781997.972483:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 345 00000100:00100000:2.0:1787781997.972492:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943075456:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781997.972561:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943075456:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 70us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.972587:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 345 00000100:00100000:2.0:1787781997.972729:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 346 00000100:00100000:2.0:1787781997.972740:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943075072:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781997.972837:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943075072:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 99us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.972844:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 346 00000100:00100000:2.0:1787781997.972858:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 347 00000100:00100000:2.0:1787781997.972865:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943075328:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787781997.972902:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2407:x1874624943075328:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 37us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.972908:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 347 00000100:00080000:2.0:1787781997.972939:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787781997.972944:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787781997.972992:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943074944 00000100:00100000:0.0:1787781997.972999:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943074944 00000100:00100000:0.0:1787781997.973039:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 391 00000100:00100000:0.0:1787781997.973060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624943074944:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787781997.973166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2407:x1874624943074944:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 118us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.973173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 391 00000100:00100000:1.0:1787781997.973294:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075200 00000100:00100000:1.0:1787781997.973299:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075200 00000100:00100000:1.0:1787781997.973392:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00100000:1.0:1787781997.973399:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943075200:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787781997.973427:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2407:x1874624943075200:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781997.973433:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00080000:0.0:1787781997.973767:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781998.086501:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963046528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781998.086588:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781998.087317:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046528 00000100:00100000:3.0:1787781998.087327:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046528 00000100:00100000:3.0:1787781998.087385:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787781998.087395:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963046528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787781998.087426:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787781998.087495:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963046528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781998.087502:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787781998.087645:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963046528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787781998.088029:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781998.088065:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781998.096005:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046656 00000100:00100000:3.0:1787781998.096019:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046656 00000100:00100000:2.0:1787781998.096211:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787781998.096221:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963046656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781998.096245:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787781998.098437:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963046656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2208us (10362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781998.098451:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787781998.100808:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781998.662694:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781998.726312:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787781998.920488:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781998.920498:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781998.920543:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787781998.920549:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787781999.688209:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782000.134104:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782000.134135:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782000.134225:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782000.134413:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046784 00000100:00100000:0.0:1787782000.134423:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046784 00000100:00100000:0.0:1787782000.134487:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787782000.134499:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963046784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787782000.134547:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787782000.134634:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963046784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782000.134643:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787782000.134706:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963046784:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1787782000.663391:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1787782000.663449:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff993d45433600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787782000.663456:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d450f2300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff993d45433b40 00000020:00080000:1.0:1787782000.663460:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff993d450f2c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff993c43d36a00 00000020:00080000:1.0:1787782000.663481:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787782000.663507:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787782000.663596:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787782000.664150:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1787782000.664161:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1787782000.669014:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669041:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669049:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669056:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787782000.669061:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669070:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669092:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff993c42526f00) 00010000:00010000:0.0:1787782000.669095:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782000.669100:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782000.669106:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5800/0xc6d6745c1506435d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782000.709924:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782001.733754:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782002.184208:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963046912:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184282:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184322:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963047424:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184347:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184367:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963047936:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184391:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184409:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963048448:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184429:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184461:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787782002.184468:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963047040:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184492:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184510:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963047552:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184542:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184562:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963048064:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184585:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184642:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963047168:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184683:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184702:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963047680:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184722:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184736:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963048192:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184754:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184767:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787782002.184773:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963047296:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184793:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184804:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963047808:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184824:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.184840:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963048320:0@lo:400:kworker.0 00000100:00100000:1.0:1787782002.184860:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782002.185690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963046912 00000100:00100000:3.0:1787782002.185698:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963046912 00000100:00100000:3.0:1787782002.185745:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787782002.185755:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624963046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.185816:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3659:x1874624963046912:12345-0@lo:400:kworker.0 Request processed in 63us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.185823:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787782002.185901:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047040 00000100:00100000:3.0:1787782002.185905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047040 00000100:00100000:3.0:1787782002.185925:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047552 00000100:00100000:3.0:1787782002.185928:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047552 00000100:00100000:3.0:1787782002.185949:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048064 00000100:00100000:3.0:1787782002.185952:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048064 00000100:00100000:3.0:1787782002.185965:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047680 00000100:00100000:3.0:1787782002.185967:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047680 00000100:00100000:3.0:1787782002.185981:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048192 00000100:00100000:3.0:1787782002.185983:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048192 00000100:00100000:3.0:1787782002.185993:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047296 00000100:00100000:3.0:1787782002.185995:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047296 00000100:00100000:3.0:1787782002.186008:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787782002.186014:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963047040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186048:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963047040:12345-0@lo:400:kworker.0 Request processed in 33us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186054:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787782002.186067:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787782002.186073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963047552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186100:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963047552:12345-0@lo:400:kworker.0 Request processed in 28us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186106:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787782002.186117:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787782002.186122:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963048064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186148:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963048064:12345-0@lo:400:kworker.0 Request processed in 26us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186161:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787782002.186173:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787782002.186179:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963047680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186214:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963047680:12345-0@lo:400:kworker.0 Request processed in 35us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186220:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787782002.186230:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787782002.186235:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963048192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186257:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963048192:12345-0@lo:400:kworker.0 Request processed in 22us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186262:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787782002.186270:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787782002.186275:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186294:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963047296:12345-0@lo:400:kworker.0 Request processed in 19us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186299:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787782002.186316:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963048576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782002.186343:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782002.186389:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963047040:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186400:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963047552:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186409:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963048064:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186416:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963046912:0@lo:400:kworker.0 00000100:00080000:3.0:1787782002.186452:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787782002.186456:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782002.186470:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963047296:0@lo:400:kworker.0 00010000:00080000:3.0:1787782002.186482:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43edde00 x1874624963047680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782002.186492:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963047680:0@lo:400:kworker.0 00010000:00080000:3.0:1787782002.186502:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43edc3c0 x1874624963048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782002.186511:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963048192:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186531:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047424 00000100:00100000:3.0:1787782002.186533:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047424 00000100:00100000:3.0:1787782002.186549:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047168 00000100:00100000:3.0:1787782002.186551:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047168 00000100:00100000:3.0:1787782002.186560:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048576 00000100:00100000:3.0:1787782002.186561:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048576 00000100:00100000:3.0:1787782002.186570:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787782002.186575:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963047424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186627:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963047424:12345-0@lo:400:kworker.0 Request processed in 52us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186633:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787782002.186644:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787782002.186649:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963047168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.186673:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963047168:12345-0@lo:400:kworker.0 Request processed in 25us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186678:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787782002.186694:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787782002.186699:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d80a1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963048576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787782002.186718:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787782002.186746:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d80a1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963048576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.186752:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787782002.187063:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963048576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782002.187086:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963047168:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187105:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963047424:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187139:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047936 00000100:00100000:3.0:1787782002.187143:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047936 00000100:00100000:3.0:1787782002.187175:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048448 00000100:00100000:3.0:1787782002.187178:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048448 00000100:00100000:3.0:1787782002.187189:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963047808 00000100:00100000:3.0:1787782002.187192:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963047808 00000100:00100000:3.0:1787782002.187201:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048320 00000100:00100000:3.0:1787782002.187203:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048320 00000100:00100000:3.0:1787782002.187215:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787782002.187220:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963047936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187258:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963047936:12345-0@lo:400:kworker.0 Request processed in 37us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.187264:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787782002.187274:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787782002.187280:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963048448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187305:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963048448:12345-0@lo:400:kworker.0 Request processed in 25us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.187320:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787782002.187332:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787782002.187338:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187368:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963047808:12345-0@lo:400:kworker.0 Request processed in 31us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.187373:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787782002.187382:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787782002.187388:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963048320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187408:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963048320:12345-0@lo:400:kworker.0 Request processed in 21us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.187413:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1787782002.187424:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782002.187427:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782002.187441:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963047808:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187450:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963048320:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187468:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787782002.187472:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff993c43750000, transno 4294967323 00000004:00080000:3.0:1787782002.187482:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787782002.187494:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963047936:0@lo:400:kworker.0 00000100:00100000:3.0:1787782002.187504:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963048448:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.694924:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782002.694945:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963048704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782002.695027:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782002.695128:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048704 00000100:00100000:1.0:1787782002.695135:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048704 00000100:00100000:1.0:1787782002.695187:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787782002.695196:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963048704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787782002.695223:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787782002.695268:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963048704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782002.695288:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787782002.695366:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963048704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782002.705971:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963048832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782002.706051:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782002.706123:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048832 00000100:00100000:2.0:1787782002.706131:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048832 00000100:00100000:2.0:1787782002.706173:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787782002.706184:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963048832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782002.706666:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787782002.706718:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963048832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 535us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782002.706725:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787782002.706778:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963048832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787782002.759857:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782003.002276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.003730:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075584 00000100:00100000:3.0:1787782003.003743:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075584 00000100:00080000:0.0:1787782003.003954:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782003.004267:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 255 00000100:00100000:3.0:1787782003.004283:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12198:x1874624943075584:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787782003.004459:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12198:x1874624943075584:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 Request processed in 183us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782003.004467:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 255 00000100:00100000:2.0:1787782003.009402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782003.009525:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075712 00000100:00100000:1.0:1787782003.009534:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075712 00000100:00100000:1.0:1787782003.009603:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 256 00000100:00100000:1.0:1787782003.009636:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:12198:x1874624943075712:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787782003.009741:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:12198:x1874624943075712:12345-192.168.206.16@tcp:60:lhsmtool_posix.0 Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782003.009748:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 256 00000100:00080000:0.0:1787782003.010125:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787782003.023178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.024003:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943075968 00000100:00100000:3.0:1787782003.024013:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943075968 00000100:00100000:3.0:1787782003.024073:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:3.0:1787782003.024083:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:12198:x1874624943075968:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787782003.024299:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:12198:x1874624943075968:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 216us (1128us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787782003.024307:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:3.0:1787782003.081402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.081455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.081487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.081515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.081546:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782003.081577:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076352 00000100:00100000:3.0:1787782003.081588:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076352 00000100:00100000:3.0:1787782003.081682:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076224 00000100:00100000:3.0:1787782003.081685:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076224 00000100:00100000:3.0:1787782003.081711:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 172 00000100:00100000:3.0:1787782003.081723:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943076352:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787782003.081994:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2406:x1874624943076352:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 272us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782003.082003:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 172 00000100:00100000:3.0:1787782003.082034:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 173 00000100:00100000:3.0:1787782003.082042:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943076224:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787782003.082093:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2406:x1874624943076224:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 52us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782003.082099:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 173 00000100:00100000:1.0:1787782003.083202:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076608 00000100:00100000:1.0:1787782003.083216:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076608 00000100:00100000:1.0:1787782003.083278:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076480 00000100:00100000:1.0:1787782003.083281:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076480 00000100:00100000:1.0:1787782003.083313:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 354 00000100:00100000:1.0:1787782003.083322:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943076608:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782003.083386:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943076608:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 65us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782003.083394:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 354 00000100:00100000:1.0:1787782003.083423:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 355 00000100:00100000:1.0:1787782003.083430:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943076480:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782003.083455:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2406:x1874624943076480:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782003.083462:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 355 00000100:00100000:0.0:1787782003.084304:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076096 00000100:00100000:0.0:1787782003.084317:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076096 00000100:00100000:0.0:1787782003.084395:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 393 00000100:00100000:0.0:1787782003.084406:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943076096:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782003.084493:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2406:x1874624943076096:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 89us (3103us total) trans 0 rc 0/0 00000100:00080000:3.0:1787782003.084498:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782003.084504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 393 00000100:00080000:3.0:1787782003.084507:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787782003.084512:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782003.084517:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782003.206386:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782003.206477:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782003.206558:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782003.206567:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963049088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782003.206592:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782003.206787:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963048960 00000100:00100000:2.0:1787782003.206796:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963048960 00000100:00100000:2.0:1787782003.206843:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049088 00000100:00100000:2.0:1787782003.206846:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049088 00000100:00100000:2.0:1787782003.206872:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787782003.206881:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963048960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782003.206908:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787782003.207043:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787782003.207052:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963049088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787782003.207063:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787782003.207184:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963048960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782003.207192:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787782003.207670:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963049088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 619us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782003.207812:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787782003.216461:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963049088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787782003.216483:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782003.634324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782003.634412:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076736 00000100:00100000:1.0:1787782003.634422:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076736 00000100:00100000:1.0:1787782003.634492:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 257 00000100:00100000:1.0:1787782003.634502:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:13002:x1874624943076736:12345-192.168.206.16@tcp:101:lsof.0 00010000:00010000:1.0:1787782003.634531:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782003.634551:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c150643e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d59 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.634638:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.634652:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.634665:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782003.634710:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787782003.634714:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787782003.635155:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.635237:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb000/0xc6d6745c150643e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d59 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.635256:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d59 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782003.635265:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:1.0:1787782003.635268:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782003.635271:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787782003.635383:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:13002:x1874624943076736:12345-192.168.206.16@tcp:101:lsof.0 Request processed in 882us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782003.635398:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 257 00010000:00010000:2.0:1787782003.781916:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782004.805835:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782005.254984:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787782005.255372:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782005.255774:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049216 00000100:00100000:1.0:1787782005.255783:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049216 00000100:00100000:1.0:1787782005.255861:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787782005.255872:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963049216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787782005.255908:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787782005.255984:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963049216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782005.255991:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787782005.256094:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963049216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787782005.829772:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787782006.738226:0:15023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:06:45 (1787782005) 00000001:00080000:1.0:1787782006.797149:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1787782006.797165:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787782006.797185:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787782006.797197:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787782006.855015:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782007.303519:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963049472:0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.303635:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782007.303710:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049472 00000100:00100000:2.0:1787782007.303717:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049472 00000100:00100000:1.0:1787782007.303927:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782007.303939:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963049344:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.303973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.304086:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787782007.304099:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304162:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963049472:12345-0@lo:400:kworker.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.304169:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787782007.304226:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963049728:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304252:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.304297:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963049856:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304340:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.304454:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049856 00000100:00100000:0.0:1787782007.304459:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049856 00000100:00100000:0.0:1787782007.304488:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787782007.304495:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304535:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963049856:12345-0@lo:400:kworker.0 Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.304541:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787782007.304577:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963049856:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304662:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963050240:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.304688:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.304718:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050240 00000100:00100000:0.0:1787782007.304723:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050240 00000100:00100000:0.0:1787782007.304758:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787782007.304765:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963050240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.304903:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963049984:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.304931:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.304958:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963049472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.304973:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787782007.304978:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963049600:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.304999:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.305017:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963050112:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.305034:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.305066:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049728 00000100:00100000:1.0:1787782007.305070:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049728 00000100:00100000:1.0:1787782007.305091:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049984 00000100:00100000:1.0:1787782007.305093:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049984 00000100:00100000:1.0:1787782007.305104:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050112 00000100:00100000:1.0:1787782007.305106:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050112 00000100:00100000:1.0:1787782007.305119:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787782007.305125:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.305215:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787782007.305227:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963049984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.305276:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963049984:12345-0@lo:400:kworker.0 Request processed in 52us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782007.305283:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787782007.305301:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787782007.305307:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963050112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.305342:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963050112:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782007.305348:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00080000:2.0:1787782007.305409:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43752580 x1874624963050112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782007.305421:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963050112:0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.305436:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963049984:0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.305473:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049344 00000100:00100000:2.0:1787782007.305483:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049344 00000100:00100000:2.0:1787782007.305512:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787782007.305518:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.305864:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963050240:12345-0@lo:400:kworker.0 Request processed in 1020us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.305874:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787782007.305897:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787782007.305901:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782007.305904:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782007.305917:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963049600 00000100:00100000:0.0:1787782007.305921:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963049600 00000100:00100000:0.0:1787782007.305945:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787782007.305950:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.305989:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963049600:12345-0@lo:400:kworker.0 Request processed in 38us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.305995:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787782007.307910:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963049728:12345-0@lo:400:kworker.0 Request processed in 2777us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.307922:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787782007.309622:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3657:x1874624963049344:12345-0@lo:400:kworker.0 Request processed in 4081us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782007.309636:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787782007.309930:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963050240:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.309950:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963049728:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.309961:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963049344:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.309997:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782007.310007:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963050368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782007.310055:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.310094:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050368 00000100:00100000:0.0:1787782007.310099:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050368 00000100:00100000:0.0:1787782007.310138:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787782007.310147:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963050368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787782007.310180:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787782007.310222:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963050368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.310229:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787782007.310266:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963050368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782007.310336:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963050752:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.310362:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.310482:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963050880:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.310508:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.310581:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050752 00000100:00100000:0.0:1787782007.310585:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050752 00000100:00100000:0.0:1787782007.310639:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787782007.310647:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963050752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.310682:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963050752:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.310702:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:0.0:1787782007.310720:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787782007.310853:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050880 00000100:00100000:0.0:1787782007.310853:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963050624:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.310860:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050880 00000100:00100000:0.0:1787782007.310888:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.310902:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787782007.310912:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963050880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.310914:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782007.310923:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963050496:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.310957:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.310968:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963050880:12345-0@lo:400:kworker.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.310977:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787782007.310980:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963051008:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.310992:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050496 00000100:00100000:1.0:1787782007.310997:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050496 00000100:00100000:0.0:1787782007.311006:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.311028:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051008 00000100:00100000:1.0:1787782007.311033:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051008 00000100:00100000:0.0:1787782007.311039:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963050624 00000100:00100000:0.0:1787782007.311044:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963050624 00000100:00100000:1.0:1787782007.311051:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787782007.311060:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963050496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.311081:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787782007.311091:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963050624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.311101:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963050496:12345-0@lo:400:kworker.0 Request processed in 42us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.311109:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787782007.311124:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787782007.311133:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963050624:12345-0@lo:400:kworker.0 Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.311135:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.311143:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787782007.311996:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963049600:0@lo:400:kworker.0 00000100:00100000:1.0:1787782007.317398:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963051008:12345-0@lo:400:kworker.0 Request processed in 6258us (6383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.317412:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:0.0:1787782007.318138:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43fd92c0 x1874624963050752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782007.318155:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963050752:0@lo:400:kworker.0 00000100:00080000:0.0:1787782007.318212:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782007.318217:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782007.318220:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782007.318240:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963050880:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.318281:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963050496:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.318306:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963051008:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.318316:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963050624:0@lo:400:kworker.0 00000100:00100000:2.0:1787782007.813814:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963051136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782007.815341:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.815527:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051136 00000100:00100000:0.0:1787782007.815535:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051136 00000100:00100000:0.0:1787782007.815622:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787782007.815631:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963051136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782007.815662:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787782007.815718:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963051136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782007.815727:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787782007.815778:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963051136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782007.815807:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963051264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782007.815848:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782007.816056:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051264 00000100:00100000:1.0:1787782007.816060:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051264 00000100:00100000:1.0:1787782007.816091:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787782007.816097:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963051264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782007.816108:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787782007.816139:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963051264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782007.816145:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787782007.816209:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963051264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787782007.878898:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782008.133842:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787782008.133854:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782008.134009:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787782008.134017:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782008.207798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782008.207893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782008.207964:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076992 00000100:00100000:1.0:1787782008.207973:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076992 00000100:00100000:1.0:1787782008.208028:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 362 00000100:00100000:1.0:1787782008.208043:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2408:x1874624943076992:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782008.208044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782008.208086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782008.208125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782008.208149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782008.208171:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077248 00000100:00100000:2.0:1787782008.208177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782008.208178:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077248 00000100:00100000:2.0:1787782008.208197:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077504 00000100:00100000:2.0:1787782008.208202:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077504 00000100:00100000:3.0:1787782008.208216:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077376 00000100:00100000:3.0:1787782008.208221:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077376 00000100:00100000:2.0:1787782008.208229:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077120 00000100:00100000:2.0:1787782008.208234:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077120 00000100:00100000:3.0:1787782008.208254:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:2.0:1787782008.208256:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077632 00000100:00100000:2.0:1787782008.208260:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077632 00000100:00100000:3.0:1787782008.208265:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943077248:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782008.208279:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 363 00000100:00100000:2.0:1787782008.208289:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2408:x1874624943077504:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787782008.208310:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2408:x1874624943077248:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 47us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.208317:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 178 00000100:00100000:2.0:1787782008.208326:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2408:x1874624943077504:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.208336:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:2.0:1787782008.208337:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 363 00000100:00100000:3.0:1787782008.208347:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943077376:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782008.208360:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 364 00000100:00100000:3.0:1787782008.208372:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943077376:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.208380:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 179 00000100:00100000:2.0:1787782008.208384:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943077120:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782008.208420:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2408:x1874624943077120:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782008.208428:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 364 00000100:00100000:2.0:1787782008.208447:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 365 00000100:00100000:2.0:1787782008.208455:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943077632:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782008.208481:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2408:x1874624943077632:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782008.208552:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 365 00000100:00100000:1.0:1787782008.208587:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:2408:x1874624943076992:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 548us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782008.208597:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 362 00000100:00080000:1.0:1787782008.208647:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787782008.208651:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782008.208653:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782008.208655:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782008.208667:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943076864 00000100:00100000:1.0:1787782008.208671:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943076864 00000100:00100000:1.0:1787782008.208712:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 395 00000100:00100000:1.0:1787782008.208719:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943076864:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782008.208745:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943076864:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782008.208757:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 395 00000100:00100000:1.0:1787782008.326011:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782008.326049:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963051392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787782008.326118:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782008.326443:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782008.326453:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963051520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782008.326483:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782008.326593:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051392 00000100:00100000:2.0:1787782008.326602:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051392 00000100:00100000:0.0:1787782008.326940:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051520 00000100:00100000:0.0:1787782008.326945:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051520 00000100:00100000:0.0:1787782008.326962:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787782008.326971:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963051392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787782008.327006:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00002000:00000024:0.0:1787782008.327008:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787782008.327015:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963051520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782008.327024:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787782008.327058:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963051392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782008.327064:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963051520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782008.327065:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787782008.327069:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787782008.327106:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963051520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782008.327236:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963051392:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787782008.902787:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782008.966512:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782009.925766:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782010.375446:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782010.375469:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963051648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782010.375539:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782010.377962:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051648 00000100:00100000:0.0:1787782010.377990:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051648 00000100:00100000:0.0:1787782010.378068:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787782010.378079:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963051648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787782010.378115:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787782010.378205:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963051648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782010.378212:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787782010.378397:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963051648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787782010.844487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782010.844573:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943077888 00000100:00100000:3.0:1787782010.844583:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943077888 00000100:00100000:3.0:1787782010.844802:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00100000:3.0:1787782010.844814:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+18:13225:x1874624943077888:12345-192.168.206.16@tcp:35:umount.0 00000100:00100000:3.0:1787782010.846346:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:13225:x1874624943077888:12345-192.168.206.16@tcp:35:umount.0 Request processed in 1529us (1938us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787782010.846357:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 66 00000100:00080000:1.0:1787782010.850398:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782010.851276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782010.851371:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943078144 00000100:00100000:0.0:1787782010.851381:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943078144 00000100:00100000:0.0:1787782010.851446:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:0.0:1787782010.851456:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+19:13225:x1874624943078144:12345-192.168.206.16@tcp:35:umount.0 00000100:00100000:0.0:1787782010.851798:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:13225:x1874624943078144:12345-192.168.206.16@tcp:35:umount.0 Request processed in 342us (527us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787782010.851807:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 67 00000100:00100000:2.0:1787782010.862758:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782010.862907:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943078400 00000100:00100000:0.0:1787782010.862916:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943078400 00000100:00100000:0.0:1787782010.862972:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:0.0:1787782010.862981:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d5886ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+20:13225:x1874624943078400:12345-192.168.206.16@tcp:35:umount.0 00000100:00100000:0.0:1787782010.863182:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d5886ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:13225:x1874624943078400:12345-192.168.206.16@tcp:35:umount.0 Request processed in 200us (431us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787782010.863190:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 68 00000100:00100000:2.0:1787782010.866321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782010.866419:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943078656 00000100:00100000:3.0:1787782010.866428:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943078656 00000100:00100000:3.0:1787782010.866483:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:3.0:1787782010.866491:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+21:13225:x1874624943078656:12345-192.168.206.16@tcp:35:umount.0 00000100:00100000:3.0:1787782010.866784:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:13225:x1874624943078656:12345-192.168.206.16@tcp:35:umount.0 Request processed in 292us (470us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787782010.866803:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 69 00000100:00100000:1.0:1787782010.873317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782010.873353:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782010.873385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782010.873534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782010.873577:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943079168 00000100:00100000:1.0:1787782010.873586:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943079168 00000100:00100000:1.0:1787782010.873681:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 80 00000100:00100000:1.0:1787782010.873690:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624943079168:12345-192.168.206.16@tcp:9:umount.0 00000020:00000080:1.0:1787782010.873718:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150636e5 00000100:00080000:1.0:1787782010.873726:0:8446:0:(import.c:65:import_set_state_nolock()) ffff993d7c4a8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787782010.873769:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787782010.873947:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+2:2405:x1874624943079168:12345-192.168.206.16@tcp:9:umount.0 Request processed in 257us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782010.873956:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 80 00010000:00010000:1.0:1787782010.873980:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782010.874001:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782010.877063:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943078784 00000100:00100000:2.0:1787782010.877077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943078784 00000100:00100000:2.0:1787782010.877149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943078912 00000100:00100000:2.0:1787782010.877152:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943078912 00000100:00100000:2.0:1787782010.877164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943079040 00000100:00100000:2.0:1787782010.877166:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943079040 00000100:00100000:2.0:1787782010.877185:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:2.0:1787782010.877193:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+15:2408:x1874624943078784:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782010.877208:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782010.877228:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43038000/0xc6d6745c150633c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838ac expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.877246:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782010.877300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+14:2408:x1874624943078784:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 108us (3992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782010.877307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:2.0:1787782010.877324:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:2.0:1787782010.877330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+13:2408:x1874624943078912:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782010.877337:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782010.877345:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039a00/0xc6d6745c1506330a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8386d expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.877353:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782010.877503:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:2408:x1874624943078912:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 172us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782010.877509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:2.0:1787782010.877523:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:2.0:1787782010.877541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:2409:x1874624943079040:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782010.877549:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782010.877557:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8800/0xc6d6745c150635e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83985 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.877565:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782010.877582:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2409:x1874624943079040:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 42us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782010.877588:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:1.0:1787782010.890666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782010.890828:0:8638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943079552 00000100:00100000:3.0:1787782010.890838:0:8638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943079552 00000100:00100000:3.0:1787782010.890914:0:8638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 81 00000100:00100000:3.0:1787782010.890924:0:8638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2405:x1874624943079552:12345-192.168.206.16@tcp:9:umount.0 00000020:00000080:3.0:1787782010.890953:0:8638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506395b 00000020:00010000:3.0:1787782010.890960:0:8638:0:(genops.c:1921:obd_stale_export_put()) Put export ffff993d454b7000: total 0 00000100:00080000:3.0:1787782010.890965:0:8638:0:(import.c:65:import_set_state_nolock()) ffff993c43d1c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782010.891005:0:8638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787782010.891139:0:8638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624943079552:12345-192.168.206.16@tcp:9:umount.0 Request processed in 216us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782010.891148:0:8638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 81 00000020:00010000:3.0:1787782010.891181:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff993d454b7000: total 0 00010000:00010000:3.0:1787782010.891206:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff993d454b7000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787782010.891254:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9952a05/0xc6d6745c150643e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d52 expref: 4 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782010.891284:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c15063d13 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b6f expref: 3 pid: 8638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782010.891300:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff993d454b7000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787782010.891311:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782010.891313:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782010.891314:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782010.892184:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782010.916537:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782010.919511:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943080576 00000100:00100000:0.0:1787782010.919526:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943080576 00000100:00100000:0.0:1787782010.919677:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 258 00000100:00100000:0.0:1787782010.919688:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+22:2405:x1874624943080576:12345-192.168.206.16@tcp:39:umount.0 00000020:00000080:0.0:1787782010.919719:0:10060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063318 00000020:00010000:0.0:1787782010.919747:0:10060:0:(genops.c:1921:obd_stale_export_put()) Put export ffff993c4346a800: total 0 00000100:00080000:0.0:1787782010.919752:0:10060:0:(import.c:65:import_set_state_nolock()) ffff993c43468000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782010.919786:0:10060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1787782010.920518:0:6519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff993c4346a800: total 0 00010000:00010000:1.0:1787782010.920571:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff993c4346a800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787782010.920666:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:1.0:1787782010.920670:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782010.920678:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15063d7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b8b expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.920697:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787782010.920699:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782010.920704:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167600/0xc6d6745c15063cd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b5a expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.920717:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787782010.920719:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782010.920723:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705e00/0xc6d6745c15064085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83c6b expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.920735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787782010.920738:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782010.920741:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e5200/0xc6d6745c150639b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83a88 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.920752:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993d679e3700) 00010000:00010000:1.0:1787782010.920755:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782010.920758:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15063660 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8399a expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922003:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787782010.922011:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782010.922020:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4400/0xc6d6745c150642c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d05 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922041:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787782010.922044:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782010.922048:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167200/0xc6d6745c15063cfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b68 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922063:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c436a4400) 00010000:00010000:1.0:1787782010.922065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782010.922068:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4600/0xc6d6745c15063644 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83993 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922086:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff993d679e1b00) 00010000:00010000:1.0:1787782010.922088:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782010.922092:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfb600/0xc6d6745c15063d98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b92 expref: 15 pid: 10060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922107:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff993d6d097e00) 00010000:00010000:1.0:1787782010.922109:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782010.922113:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705000/0xc6d6745c15063bf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83b22 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922127:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787782010.922129:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782010.922147:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705600/0xc6d6745c150643cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d4b expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922163:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff993c436a7c00) 00010000:00010000:1.0:1787782010.922165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782010.922168:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c150636bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb839af expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922182:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff993c42526300) 00010000:00010000:1.0:1787782010.922184:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782010.922187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d412e4200/0xc6d6745c150643a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d3d expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.922215:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff993c4346a800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787782010.922242:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782010.922244:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782010.922246:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782010.923127:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+7:2405:x1874624943080576:12345-192.168.206.16@tcp:39:umount.0 Request processed in 3435us (6594us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787782010.923139:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 258 00000100:00100000:1.0:1787782010.936255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782010.938084:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943080704 00000100:00100000:0.0:1787782010.938099:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943080704 00000100:00100000:0.0:1787782010.938633:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 259 00000100:00100000:0.0:1787782010.938646:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+5:2405:x1874624943080704:12345-192.168.206.16@tcp:39:umount.0 00000020:00000080:0.0:1787782010.938688:0:6533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506331f 00000100:00080000:0.0:1787782010.938705:0:6533:0:(import.c:65:import_set_state_nolock()) ffff993c431b7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782010.938942:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787782010.939102:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd0eda9e-1cb2-4b8a-8952-0f785606e4c5+3:2405:x1874624943080704:12345-192.168.206.16@tcp:39:umount.0 Request processed in 459us (2859us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787782010.939111:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 259 00000100:00080000:1.0:1787782010.944452:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787782010.944700:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782010.949866:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782011.974181:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782012.422004:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963052032:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.422074:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963051776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782012.422274:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963051904:0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.422320:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963052160:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.423769:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.423894:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963052288:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.423922:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.423940:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963052800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.423961:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.423982:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963053312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424000:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.424054:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052288 00000100:00100000:1.0:1787782012.424061:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052288 00000100:00100000:1.0:1787782012.424101:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787782012.424108:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963052288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424158:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963052288:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.424444:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787782012.424473:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052800 00000100:00100000:1.0:1787782012.424476:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052800 00000100:00100000:1.0:1787782012.424506:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053312 00000100:00100000:1.0:1787782012.424508:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053312 00000100:00100000:1.0:1787782012.424526:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787782012.424531:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963052800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424563:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963052800:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.424569:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787782012.424580:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787782012.424586:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963053312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424631:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963053312:12345-0@lo:400:kworker.0 Request processed in 45us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.424637:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1787782012.424657:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782012.424661:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782012.424687:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963052288:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424697:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963052800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424706:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963053312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.424766:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051776 00000100:00100000:1.0:1787782012.424771:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051776 00000100:00100000:1.0:1787782012.424884:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787782012.424891:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963051776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787782012.424916:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787782012.424954:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963051776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.424960:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787782012.424989:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963051776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782012.425128:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.425152:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.425191:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963052416:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.425311:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.425336:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963052928:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.425340:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052032 00000100:00100000:1.0:1787782012.425345:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052032 00000100:00100000:0.0:1787782012.425368:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.425380:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787782012.425390:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963052032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.425392:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963053440:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.425436:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963052032:12345-0@lo:400:kworker.0 Request processed in 48us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.425445:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.425450:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787782012.425478:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.425486:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052928 00000100:00100000:0.0:1787782012.425490:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052928 00000100:00100000:3.0:1787782012.425522:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963052032:0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.425534:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963052544:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.425544:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053440 00000100:00100000:0.0:1787782012.425549:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053440 00000100:00100000:2.0:1787782012.425571:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963052672:0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.425572:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.425574:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787782012.425583:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963052928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.425605:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.425639:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963053056:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.425642:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963052928:12345-0@lo:400:kworker.0 Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.425652:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787782012.425665:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787782012.425672:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963053440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.425690:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052416 00000100:00100000:1.0:1787782012.425695:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052416 00000100:00100000:1.0:1787782012.425714:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052160 00000100:00100000:1.0:1787782012.425716:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052160 00000100:00100000:1.0:1787782012.425726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787782012.425731:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963052416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.425777:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963053184:0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.425893:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782012.425906:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787782012.425914:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963052160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.426110:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963052160:12345-0@lo:400:kworker.0 Request processed in 196us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.426117:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052544 00000100:00100000:2.0:1787782012.426120:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787782012.426123:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052544 00000100:00100000:2.0:1787782012.426148:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.426161:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963052672 00000100:00100000:2.0:1787782012.426179:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963052160:0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.426210:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053056 00000100:00100000:2.0:1787782012.426214:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053056 00000100:00100000:2.0:1787782012.426232:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053184 00000100:00100000:2.0:1787782012.426243:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053184 00000100:00100000:3.0:1787782012.426260:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963052672 00000100:00100000:0.0:1787782012.427044:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963053440:12345-0@lo:400:kworker.0 Request processed in 1369us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.427045:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963052416:12345-0@lo:400:kworker.0 Request processed in 1310us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.427063:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787782012.427063:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787782012.427102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963051904 00000100:00080000:0.0:1787782012.427107:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782012.427113:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782012.427115:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963051904 00000100:00080000:0.0:1787782012.427117:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782012.427146:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963052416:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.427156:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787782012.427162:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963052928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.427176:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963053440:0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.427184:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963051904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.427231:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3658:x1874624963051904:12345-0@lo:400:kworker.0 Request processed in 68us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.427238:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787782012.427269:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787782012.427277:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963052544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.427313:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963052544:12345-0@lo:400:kworker.0 Request processed in 37us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.427319:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787782012.427333:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787782012.427339:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782012.427364:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963053056:12345-0@lo:400:kworker.0 Request processed in 26us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.427370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787782012.427698:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00080000:1.0:1787782012.427752:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787782012.429217:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963051904:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.430951:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963053056:0@lo:400:kworker.0 00000100:00100000:0.0:1787782012.430968:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963052544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.431141:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787782012.431152:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963052672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.431379:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963052672:12345-0@lo:400:kworker.0 Request processed in 228us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.431386:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00080000:3.0:1787782012.431420:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43752d00 x1874624963052672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782012.431432:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963052672:0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.431539:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963053184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782012.431585:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963053184:12345-0@lo:400:kworker.0 Request processed in 3880us (5438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782012.431592:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00080000:3.0:1787782012.438027:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd52c0 x1874624963053184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782012.438047:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963053184:0@lo:400:kworker.0 00000100:00100000:3.0:1787782012.931894:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782012.931940:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782012.931981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782012.932023:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943080832 00000100:00100000:0.0:1787782012.932023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943080960 00000100:00100000:3.0:1787782012.932037:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943080832 00000100:00100000:0.0:1787782012.932042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943080960 00000100:00100000:3.0:1787782012.932139:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081088 00000100:00100000:3.0:1787782012.932145:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081088 00000100:00100000:0.0:1787782012.934891:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787782012.934916:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+12:2408:x1874624943080832:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782012.934953:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782012.934978:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150fa00/0xc6d6745c1506341b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838c1 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.934998:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782012.935070:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+11:2408:x1874624943080832:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 166us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.935079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:0.0:1787782012.935103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:0.0:1787782012.935110:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+10:2408:x1874624943080960:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782012.935117:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782012.935128:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8c00/0xc6d6745c15063422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838f2 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.935137:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782012.935156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+9:2408:x1874624943080960:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 48us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.935163:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:0.0:1787782012.935177:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:0.0:1787782012.935185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+8:2408:x1874624943081088:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782012.935193:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782012.935283:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039400/0xc6d6745c150635db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb8397e expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.935293:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782012.935312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+7:2408:x1874624943081088:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 129us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.935326:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:0.0:1787782012.936104:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963053568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782012.936150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.936182:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053568 00000100:00100000:0.0:1787782012.936189:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053568 00000100:00100000:0.0:1787782012.937735:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787782012.937751:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963053568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782012.938645:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787782012.938719:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963053568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 973us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.938727:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787782012.938850:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963053696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787782012.938891:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.938938:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053696 00000100:00100000:1.0:1787782012.938945:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053696 00000100:00100000:1.0:1787782012.938986:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787782012.938995:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963053696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787782012.939007:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787782012.939042:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963053696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.939064:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787782012.939626:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963053568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782012.939845:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963053696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782012.953817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782012.953932:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081344 00000100:00100000:0.0:1787782012.953942:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081344 00000100:00100000:0.0:1787782012.954032:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 260 00000100:00100000:0.0:1787782012.954042:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+6:2405:x1874624943081344:12345-192.168.206.16@tcp:39:umount.0 00000020:00000080:0.0:1787782012.954079:0:10060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063437 00000020:00010000:0.0:1787782012.954087:0:10060:0:(genops.c:1921:obd_stale_export_put()) Put export ffff993c437f2000: total 0 00000100:00080000:0.0:1787782012.954092:0:10060:0:(import.c:65:import_set_state_nolock()) ffff993c437f6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782012.954152:0:10060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1787782012.954305:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2405:x1874624943081344:12345-192.168.206.16@tcp:39:umount.0 Request processed in 264us (507us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1787782012.954313:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 260 00000020:00010000:2.0:1787782012.954458:0:6519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff993c437f2000: total 0 00000100:00080000:1.0:1787782012.954476:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782012.954511:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff993c437f2000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787782012.954549:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d6d097400) 00010000:00010000:2.0:1787782012.954553:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782012.954562:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43dfac00/0xc6d6745c150643f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d59 expref: 4 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.954585:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff993c437f2000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787782012.954597:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.954599:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.954601:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782012.966820:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782012.967082:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081472 00000100:00100000:2.0:1787782012.967093:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081472 00000100:00100000:2.0:1787782012.967170:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 261 00000100:00100000:2.0:1787782012.967180:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+5:2405:x1874624943081472:12345-192.168.206.16@tcp:39:umount.0 00000020:00000080:2.0:1787782012.967217:0:6532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063430 00000100:00080000:2.0:1787782012.967226:0:6532:0:(import.c:65:import_set_state_nolock()) ffff993d67f86800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787782012.967254:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787782012.967415:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bc9a1c7-2800-4790-98ed-a61ff9e58135+3:2405:x1874624943081472:12345-192.168.206.16@tcp:39:umount.0 Request processed in 237us (612us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787782012.967424:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 261 00010000:00010000:3.0:1787782012.967729:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782012.967780:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787782012.997970:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782013.006830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782013.006929:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081728 00000100:00100000:2.0:1787782013.006939:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081728 00000100:00100000:2.0:1787782013.007001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 397 00000100:00100000:2.0:1787782013.007011:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+7:2405:x1874624943081728:12345-192.168.206.16@tcp:251:umount.0 00000020:00000080:2.0:1787782013.007063:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150632f5 00000020:00010000:2.0:1787782013.007071:0:6523:0:(genops.c:1921:obd_stale_export_put()) Put export ffff993c426ae800: total 0 00000100:00080000:2.0:1787782013.007075:0:6523:0:(import.c:65:import_set_state_nolock()) ffff993c426a9800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787782013.007147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9949f27-7277-4132-a8a2-0bcf34a2f9bc+3:2405:x1874624943081728:12345-192.168.206.16@tcp:251:umount.0 Request processed in 138us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782013.007154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 397 00000020:00010000:3.0:1787782013.007416:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff993c426ae800: total 0 00010000:00010000:3.0:1787782013.007421:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782013.007467:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff993c426ae800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787782013.007501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150e000/0xc6d6745c150633ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb838b3 expref: 2 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782013.007516:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff993c426ae800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787782013.007526:0:6520:0:(genops.c:885:class_export_put()) final put ffff993c426ae800/e9949f27-7277-4132-a8a2-0bcf34a2f9bc 00010000:00010000:3.0:1787782013.007542:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782013.007544:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782013.007554:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787782013.007813:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426ae800/e9949f27-7277-4132-a8a2-0bcf34a2f9bc for MGS 00000020:00000080:2.0:1787782013.007854:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c426a9800 for MGS 00000100:00100000:3.0:1787782013.445930:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963053824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782013.446030:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782013.446180:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053824 00000100:00100000:0.0:1787782013.446190:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053824 00000100:00100000:0.0:1787782013.446257:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787782013.446267:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963053824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782013.446303:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787782013.446653:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963053952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787782013.446690:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782013.446736:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963053952 00000100:00100000:1.0:1787782013.446740:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963053952 00000100:00100000:1.0:1787782013.446781:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787782013.446789:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963053952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782013.446810:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787782013.446844:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963053952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782013.446851:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787782013.446902:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963053952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782013.447322:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963053824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1053us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782013.447332:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787782013.451324:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963053824:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787782013.959585:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00080000:3.0:1787782013.959600:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1787782013.959628:0:6509:0:(genops.c:885:class_export_put()) final put ffff993c437f2000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00100000:3.0:1787782013.959711:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000001:00080000:3.0:1787782013.959717:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787782013.959726:0:6509:0:(genops.c:885:class_export_put()) final put ffff993c4346a800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:2.0:1787782013.959795:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c437f2000/7bc9a1c7-2800-4790-98ed-a61ff9e58135 for lustre-MDT0000 00000020:00000080:2.0:1787782013.959858:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c4346a800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-MDT0000 00000020:00000080:2.0:1787782013.959881:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c437f6800 for lustre-MDT0000 00000020:00000080:2.0:1787782013.959885:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c43468000 for lustre-MDT0000 00010000:00010000:1.0:1787782014.022838:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787782014.751161:0:15218:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787782014.773380:0:15218:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787782014.773438:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.773454:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.773462:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.773469:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.773496:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787782014.773502:0:15218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787782014.773529:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782014.773534:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787782014.773540:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787782014.773578:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d77184800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787782014.773699:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963054080:0@lo:39:umount.0 00000100:00100000:1.0:1787782014.773763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782014.773993:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054080 00000100:00100000:0.0:1787782014.774014:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054080 00000100:00100000:0.0:1787782014.774069:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787782014.774077:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874624963054080:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787782014.774100:0:10060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f0c 00000100:00080000:0.0:1787782014.774107:0:10060:0:(import.c:65:import_set_state_nolock()) ffff993d46f69800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787782014.774160:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1874624963054080:12345-0@lo:39:umount.0 Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782014.774167:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787782014.774174:0:10060:0:(genops.c:885:class_export_put()) final put ffff993d46f6d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787782014.774196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d46f6d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787782014.774230:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d46f69800 for lustre-MDT0000 00010000:00010000:3.0:1787782014.774461:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782014.774470:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774479:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41481000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782014.774483:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774492:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782014.774500:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782014.774506:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782014.774509:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787782014.774511:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787782014.774538:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774556:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782014.774591:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774599:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d41481000/0xc6d6745c1506339d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774634:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.774636:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.774638:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782014.774649:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782014.774662:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963054208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782014.774698:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782014.774736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054208 00000100:00100000:3.0:1787782014.774741:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054208 00000100:00100000:3.0:1787782014.774776:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782014.774783:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+24:3660:x1874624963054208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782014.774804:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782014.774820:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8e00/0xc6d6745c150633a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c1506339d expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.774831:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782014.774860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3660:x1874624963054208:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782014.774866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782014.774899:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963054208:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787782014.775725:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77184800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787782014.775746:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963054080:0@lo:39:umount.0 00000100:00080000:0.0:1787782014.775768:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782014.775771:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782014.775776:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787782014.776044:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782014.777180:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777194:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777202:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777209:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777267:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782014.777273:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777298:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777303:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.777308:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777597:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782014.777630:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777637:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782014.777641:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777649:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782014.777656:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782014.777661:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782014.777663:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787782014.777695:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777701:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782014.777735:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777743:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8000/0xc6d6745c150633ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150633b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777755:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782014.777757:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777763:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782014.777765:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777779:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782014.777785:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782014.777790:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782014.777792:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787782014.777817:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777822:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782014.777852:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.777860:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.777862:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.777864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782014.777880:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963054464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782014.777939:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782014.778003:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054464 00000100:00100000:3.0:1787782014.778009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054464 00000100:00100000:3.0:1787782014.778050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782014.778059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+23:3657:x1874624963054464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782014.778072:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782014.778085:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039e00/0xc6d6745c150632b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c150632af expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.778098:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782014.778138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3657:x1874624963054464:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782014.778146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782014.778180:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963054464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782014.778305:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782014.778316:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963054336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782014.778357:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782014.778493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054336 00000100:00100000:3.0:1787782014.778498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054336 00000100:00100000:3.0:1787782014.778534:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782014.778541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+22:3659:x1874624963054336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782014.778549:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782014.778559:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150f800/0xc6d6745c150633b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c150633ab expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.778569:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782014.778600:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3659:x1874624963054336:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782014.778628:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782014.778653:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963054336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782014.778848:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787782014.778855:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9600/0xc6d6745c150632af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c150632b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782014.778866:0:15218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787782014.778875:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.778881:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.778888:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.778894:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779011:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782014.779017:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779024:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782014.779027:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779048:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782014.779055:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782014.779061:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787782014.779063:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787782014.779080:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779086:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782014.779118:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779127:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782014.779129:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782014.779131:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782014.779183:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963054592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782014.779215:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782014.779327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054592 00000100:00100000:2.0:1787782014.779332:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054592 00000100:00100000:2.0:1787782014.779440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787782014.779448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+21:3658:x1874624963054592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782014.779457:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782014.779468:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039000/0xc6d6745c1506361a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c15063613 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782014.779478:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782014.779520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3658:x1874624963054592:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782014.779536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787782014.779644:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3658:1874624963054592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782014.779810:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787782014.779816:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d412e5a00/0xc6d6745c15063613 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506361a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782014.779979:0:15218:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787782014.779988:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.779995:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.780001:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782014.780007:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.780059:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782014.780066:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.780073:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782014.780077:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.780096:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782014.780103:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782014.780109:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782014.780112:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1787782014.780130:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.780136:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787782014.780178:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963054720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782014.780213:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782014.780277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054720 00000100:00100000:1.0:1787782014.780282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054720 00000100:00100000:1.0:1787782014.780325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787782014.780332:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+20:3659:x1874624963054720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782014.780340:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782014.780364:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d40030600/0xc6d6745c15062e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6d6745c15062e6b expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782014.780375:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782014.780422:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782014.780432:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.780434:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.780436:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782014.780540:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787782014.780545:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166c00/0xc6d6745c15062e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062e72 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782014.780556:0:15218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1787782014.780561:0:15218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787782014.780563:0:15218:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787782014.780602:0:15218:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787782014.780637:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787782014.780642:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782014.780650:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1787782014.780655:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff993c431b4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782014.780660:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff993c41fa9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782014.780665:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff993d77183000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782014.780670:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff993d46fd5000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1787782014.780681:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff993d725dcd28) has exports, disconnecting them 00000020:00080000:0.0:1787782014.780685:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff993c431b4800), last request at 1787782012 00000020:00000080:0.0:1787782014.780692:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506321c 00000100:00080000:0.0:1787782014.780709:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993c431b2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782014.780760:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c431b4800): rc 0 00000020:00000080:0.0:1787782014.780763:0:15218:0:(genops.c:885:class_export_put()) final put ffff993c431b4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787782014.780771:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff993c41fa9000), last request at 1787782012 00000020:00000080:0.0:1787782014.780775:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150630f6 00000100:00080000:0.0:1787782014.780780:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993c41fab000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782014.780791:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c41fa9000): rc 0 00000020:00000080:0.0:1787782014.780792:0:15218:0:(genops.c:885:class_export_put()) final put ffff993c41fa9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787782014.780809:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff993d77183000), last request at 1787781781 00000020:00000080:0.0:1787782014.780811:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062ff3 00000100:00080000:0.0:1787782014.780815:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d77183800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782014.780822:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d77183000): rc 0 00000020:00000080:0.0:1787782014.780824:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d77183000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787782014.780828:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff993d46fd5000), last request at 1787781781 00000020:00000080:3.0:1787782014.780957:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c431b4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782014.780998:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41fa9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782014.781017:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d77183000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782014.781035:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c431b2800 for lustre-MDT0000 00000020:00000080:3.0:1787782014.781039:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c41fab000 for lustre-MDT0000 00000020:00000080:3.0:1787782014.781043:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d77183800 for lustre-MDT0000 00010000:00010000:3.0:1787782014.781055:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.781061:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.781064:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782014.781103:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062fc2 00000100:00080000:0.0:1787782014.781108:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d46fd0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782014.781126:0:15218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1787782014.781203:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d46fd5000): rc 0 00000004:00000080:0.0:1787782014.781208:0:15218:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffabe280d7fae0 00000100:00080000:0.0:1787782014.781227:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787782014.781231:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1787782014.781434:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782014.782318:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787782014.782526:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d77184000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787782014.782591:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963054848:0@lo:39:umount.0 00000100:00100000:0.0:1787782014.782695:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782014.783162:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624963054720:12345-0@lo:103:ldlm_bl.0 Request processed in 2828us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782014.783173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787782014.783668:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782014.783875:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963054720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782014.783909:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054848 00000100:00100000:2.0:1787782014.783915:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054848 00000100:00100000:2.0:1787782014.783966:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787782014.783975:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874624963054848:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787782014.784003:0:7892:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506304e 00000100:00080000:2.0:1787782014.784012:0:7892:0:(import.c:65:import_set_state_nolock()) ffff993d46fd7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787782014.784031:0:7892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787782014.784171:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3656:x1874624963054848:12345-0@lo:39:umount.0 Request processed in 196us (1475us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787782014.784179:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1787782014.784215:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77184000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787782014.784223:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963054848:0@lo:39:umount.0 00010000:00010000:3.0:1787782014.784359:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782014.784806:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787782014.784810:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1787782014.784826:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787782014.784894:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787782014.784913:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d7c44c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787782014.784936:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787782014.784938:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1787782014.784948:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787782014.785011:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787782014.785022:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993c43c28800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787782014.785048:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff993d725dcd28) has no exports 00000100:00100000:1.0:1787782014.785337:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963054976:0@lo:9:umount.0 00000100:00100000:1.0:1787782014.785395:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782014.785427:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963055104:0@lo:9:umount.0 00000100:00100000:1.0:1787782014.785447:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782014.785479:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963054976 00000100:00100000:1.0:1787782014.785485:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963054976 00000100:00100000:1.0:1787782014.785522:0:13830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055104 00000100:00100000:1.0:1787782014.785525:0:13830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055104 00000100:00100000:1.0:1787782014.785543:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787782014.785550:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874624963054976:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787782014.785567:0:13830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506319e 00000100:00080000:1.0:1787782014.785574:0:13830:0:(import.c:65:import_set_state_nolock()) ffff993c41cc6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787782014.785639:0:13830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787782014.785743:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3656:x1874624963054976:12345-0@lo:9:umount.0 Request processed in 193us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782014.785750:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787782014.785763:0:13830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787782014.785769:0:13830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874624963055104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787782014.785790:0:13830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150632e0 00000100:00080000:1.0:1787782014.785807:0:13830:0:(import.c:65:import_set_state_nolock()) ffff993c43c2b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787782014.785838:0:13830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787782014.785905:0:13830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3656:x1874624963055104:12345-0@lo:9:umount.0 Request processed in 136us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782014.785911:0:13830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787782014.785928:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782014.785932:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782014.785993:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d7c44c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787782014.786001:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787782014.786003:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787782014.786006:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963054976:0@lo:9:umount.0 00000100:00080000:1.0:1787782014.786015:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c43c28800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787782014.786023:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787782014.786024:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787782014.786026:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963055104:0@lo:9:umount.0 00010000:00010000:3.0:1787782014.786639:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782014.786646:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787782014.792984:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff993d725dcd28) has no exports 00000020:00000080:0.0:1787782014.840928:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062ec6 00000020:00000080:0.0:1787782014.840945:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d770ff800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787782014.841164:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787782014.842216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d770ff800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787782014.846682:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782014.846697:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787782014.846702:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff993d725d99b8) has no exports 00000020:00000080:1.0:1787782014.847535:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062ebf 00000020:00000080:1.0:1787782014.847545:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d725f3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787782014.847602:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782014.847649:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787782014.847652:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d725f0000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787782014.847655:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787782014.847664:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787782014.847983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787782015.045892:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782016.075258:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782017.037598:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782017.037701:0:8439:0:(genops.c:885:class_export_put()) final put ffff993c41cc0000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787782017.037728:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:0.0:1787782017.037730:0:8439:0:(genops.c:885:class_export_put()) final put ffff993d454b7000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:3.0:1787782017.037816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41cc0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787782017.037894:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d454b7000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-OST0000 00000020:00000080:3.0:1787782017.037918:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c41cc6000 for lustre-OST0000 00000020:00000080:3.0:1787782017.037923:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c43d1c000 for lustre-OST0000 00000001:00100000:0.0:1787782017.038013:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782017.038018:0:9524:0:(genops.c:885:class_export_put()) final put ffff993c43c2d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787782017.038028:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:0.0:1787782017.038030:0:9524:0:(genops.c:885:class_export_put()) final put ffff993c43e99000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:3.0:1787782017.038074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c43c2d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787782017.038096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c43e99000/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-OST0001 00000020:00000080:3.0:1787782017.038115:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c43c2b800 for lustre-OST0001 00000020:00000080:3.0:1787782017.038119:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d7c4a8000 for lustre-OST0001 00000001:00100000:2.0:1787782017.040644:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787782017.040658:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787782017.040663:0:7461:0:(genops.c:885:class_export_put()) final put ffff993d67ed3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787782017.040746:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000001:00080000:2.0:1787782017.040750:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787782017.040752:0:7461:0:(genops.c:885:class_export_put()) final put ffff993d67f83800/7bc9a1c7-2800-4790-98ed-a61ff9e58135 00000020:00000080:1.0:1787782017.041301:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67ed3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787782017.041369:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d46fd7800 for lustre-MDT0001 00000001:00100000:2.0:1787782017.041767:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000001:00080000:2.0:1787782017.041778:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787782017.041791:0:7461:0:(genops.c:885:class_export_put()) final put ffff993c426ad800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 00000020:00000080:3.0:1787782017.041829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67f83800/7bc9a1c7-2800-4790-98ed-a61ff9e58135 for lustre-MDT0001 00000020:00000080:3.0:1787782017.041866:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d67f86800 for lustre-MDT0001 00000020:00000080:1.0:1787782017.041982:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426ad800/cd0eda9e-1cb2-4b8a-8952-0f785606e4c5 for lustre-MDT0001 00000020:00000080:1.0:1787782017.042079:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c431b7000 for lustre-MDT0001 00010000:00010000:3.0:1787782017.093883:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782017.543853:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963055360:0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.543935:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.543987:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963055872:0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.544013:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.544038:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787782017.544044:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963055488:0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.544067:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.544082:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963056000:0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.544099:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.544138:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055360 00000100:00100000:1.0:1787782017.544144:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055360 00000100:00100000:1.0:1787782017.544188:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787782017.544195:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874624963055360:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787782017.544202:0:6536:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787782017.544239:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874624963055360:12345-0@lo:400:kworker.0 Request processed in 43us (305us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787782017.544247:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787782017.544269:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055872 00000100:00100000:1.0:1787782017.544272:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055872 00000100:00100000:1.0:1787782017.544306:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787782017.544312:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.544351:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963055872:12345-0@lo:400:kworker.0 Request processed in 34us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782017.544358:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787782017.544554:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055488 00000100:00100000:1.0:1787782017.544559:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055488 00000100:00100000:1.0:1787782017.544597:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056000 00000100:00100000:1.0:1787782017.544600:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056000 00000100:00100000:1.0:1787782017.544641:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787782017.544646:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874624963055488:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787782017.544651:0:6531:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787782017.544690:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874624963055488:12345-0@lo:400:kworker.0 Request processed in 42us (621us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787782017.544695:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787782017.544706:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787782017.544710:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874624963056000:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787782017.544714:0:6531:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787782017.544734:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874624963056000:12345-0@lo:400:kworker.0 Request processed in 23us (635us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787782017.544740:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1787782017.544755:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782017.544800:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787782017.544805:0:3657:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787782017.544808:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787782017.545002:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963055232:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545038:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545066:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963055744:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545086:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545101:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963056256:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545119:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545138:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787782017.545144:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963055616:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545163:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545178:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963056128:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545198:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545222:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055232 00000100:00100000:2.0:1787782017.545226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055232 00000100:00100000:2.0:1787782017.545254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787782017.545260:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624963055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545295:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624963055232:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782017.545301:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787782017.545328:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056256 00000100:00100000:2.0:1787782017.545331:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056256 00000100:00100000:2.0:1787782017.545360:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787782017.545366:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963056256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545410:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963056256:12345-0@lo:400:kworker.0 Request processed in 43us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782017.545416:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787782017.545440:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055744 00000100:00100000:2.0:1787782017.545451:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055744 00000100:00100000:2.0:1787782017.545474:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963055616 00000100:00100000:2.0:1787782017.545477:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963055616 00000100:00100000:2.0:1787782017.545484:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056128 00000100:00100000:2.0:1787782017.545497:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056128 00000100:00100000:2.0:1787782017.545511:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787782017.545516:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963055744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545545:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963055744:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782017.545551:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787782017.545561:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787782017.545566:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963056128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545596:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963056128:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782017.545602:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787782017.545634:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787782017.545638:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1874624963055616:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787782017.545643:0:6533:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787782017.545666:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1874624963055616:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787782017.545671:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787782017.545688:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787782017.545691:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782017.545713:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787782017.545717:0:3660:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787782017.545721:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787782017.545725:0:3660:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782017.545735:0:3660:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 238 00000100:00080000:2.0:1787782017.545741:0:3660:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782017.545765:0:3660:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd4000 x1874624963056384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782017.545797:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963055616:0@lo:400:kworker.0 00010000:00080000:2.0:1787782017.545812:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43750b40 x1874624963056128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782017.545823:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963056128:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545832:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963055232:0@lo:400:kworker.0 00010000:00080000:2.0:1787782017.545840:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43751680 x1874624963055744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782017.545849:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963055744:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545858:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963056256:0@lo:400:kworker.0 00000100:00100000:2.0:1787782017.545890:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963056384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787782017.545914:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782017.545937:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056384 00000100:00100000:2.0:1787782017.545940:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056384 00000100:00100000:2.0:1787782017.545957:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787782017.545961:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963056384:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787782017.545973:0:6533:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782017.546749:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782017.546762:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963056512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782017.546813:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782017.546849:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056512 00000100:00100000:3.0:1787782017.546854:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056512 00000100:00100000:3.0:1787782017.546879:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787782017.546884:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1874624963056512:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787782017.546889:0:6537:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787782017.546936:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1874624963056512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (123us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787782017.546957:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:02020000:3.0:1787782017.546988:0:3658:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787782017.547000:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787782017.547004:0:3658:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787782017.547008:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787782017.547013:0:3658:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782017.547016:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:3.0:1787782017.547022:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff993d679fd800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782017.547047:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d44eb4000 x1874624963056640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782017.547075:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963056640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787782017.547100:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782017.547127:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056640 00000100:00100000:3.0:1787782017.547131:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056640 00000100:00100000:3.0:1787782017.547147:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787782017.547152:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963056640:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787782017.547175:0:7892:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782017.547207:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963056640:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 53us (106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782017.547212:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1787782017.547232:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782017.547236:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787782017.547240:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963056640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787782017.582752:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963056384:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36783us (36831us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787782017.582768:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1787782017.582804:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782017.582815:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787782017.582823:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963056384:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1787782017.597714:0:3657:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782017.597733:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:1.0:1787782017.597745:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff993d78ce4000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782017.598225:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e43480 x1874624963056768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782017.598297:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963056768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787782017.598601:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.598732:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963055488:0@lo:400:kworker.0 00000100:00080000:1.0:1787782017.598769:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787782017.598775:0:3657:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787782017.598800:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787782017.598805:0:3657:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782017.598809:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 259 00000100:00080000:1.0:1787782017.598817:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782017.599524:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e42d00 x1874624963056896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782017.599556:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963056000:0@lo:400:kworker.0 00000100:00080000:1.0:1787782017.599578:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787782017.599582:0:3657:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff993d679fd800 already not connected (conn 2, was 1): DISCONN 00000100:00100000:1.0:1787782017.599586:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963055360:0@lo:400:kworker.0 00000100:00100000:1.0:1787782017.600066:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963055872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782017.600257:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963056896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787782017.600342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782017.600569:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056768 00000100:00100000:1.0:1787782017.600578:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056768 00000100:00100000:1.0:1787782017.600654:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963056896 00000100:00100000:1.0:1787782017.600657:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963056896 00000100:00100000:1.0:1787782017.600677:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787782017.600686:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963056768:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787782017.600705:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787782017.600756:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963056768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (2155us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782017.600763:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787782017.600793:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787782017.600798:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963056896:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787782017.600805:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787782017.600857:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963056896:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782017.600864:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787782017.600964:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782017.600970:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787782017.600974:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963056896:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787782017.600986:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782017.600989:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787782017.600992:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963056768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787782018.054510:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963057024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787782018.054651:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782018.057890:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057024 00000100:00100000:1.0:1787782018.057910:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057024 00000100:00100000:1.0:1787782018.058003:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787782018.058014:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963057024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787782018.058058:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787782018.058179:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963057024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782018.058187:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787782018.058391:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963057024:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787782018.124852:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782018.182393:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787782018.572546:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963057152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782018.572663:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782018.573048:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057152 00000100:00100000:2.0:1787782018.573059:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057152 00000100:00100000:2.0:1787782018.573130:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787782018.573142:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963057152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787782018.573186:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787782018.573256:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963057152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782018.573265:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787782018.573534:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963057152:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787782019.141960:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782020.165996:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787782021.129870:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787782021.129879:0:6509:0:(genops.c:885:class_export_put()) final put ffff993d46fd5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787782021.129957:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d46fd5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787782021.130016:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d46fd0000 for lustre-MDT0000 00010000:00010000:3.0:1787782021.189904:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782022.214283:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782022.662013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782022.662021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782022.662026:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782022.662036:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1787782022.662044:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787782022.662055:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff993d679fd800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782022.662087:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a52c0 x1874624963057408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782022.662097:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963057280:0@lo:400:kworker.0 00000100:00080000:0.0:1787782022.662118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782022.662124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782022.662149:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782022.662156:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1787782022.662160:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787782022.662166:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff993d78ce4000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782022.662182:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a7480 x1874624963057536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782022.662193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787782022.662199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782022.662201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782022.662205:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782022.662211:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 454 00000100:00100000:2.0:1787782022.662409:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963057408:0@lo:38:kworker.0 00000100:00100000:2.0:1787782022.662472:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782022.662511:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963057536:0@lo:38:kworker.0 00000100:00100000:3.0:1787782022.662534:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057408 00000100:00100000:3.0:1787782022.662543:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057408 00000100:00100000:2.0:1787782022.662544:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782022.662590:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787782022.662599:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963057408:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787782022.662660:0:7892:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787782022.662716:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787782022.662723:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782022.662741:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a6940 x1874624963057664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782022.662800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782022.662804:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782022.662806:0:36:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782022.662810:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1787782022.662813:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787782022.662816:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782022.662828:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4000 x1874624963058048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782022.662927:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963057792:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.663059:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057280 00000100:00100000:1.0:1787782022.663066:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057280 00000100:00100000:1.0:1787782022.663113:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787782022.663122:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624963057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782022.663198:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963057664:0@lo:38:kworker.0 00000100:00100000:1.0:1787782022.667203:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3660:x1874624963057280:12345-0@lo:400:kworker.0 Request processed in 4070us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782022.667232:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787782022.667317:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057536 00000100:00100000:1.0:1787782022.667326:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057536 00000100:00100000:1.0:1787782022.667383:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787782022.667391:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963057536:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787782022.667411:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787782022.667457:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963057536:12345-0@lo:38:kworker.0 Request processed in 66us (4914us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782022.667464:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787782022.667544:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963057920:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.667587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782022.667654:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963058176:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.667682:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782022.667702:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782022.667710:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963058304:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.667732:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782022.667777:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057920 00000100:00100000:1.0:1787782022.667781:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057920 00000100:00100000:1.0:1787782022.667827:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058304 00000100:00100000:1.0:1787782022.667830:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058304 00000100:00100000:1.0:1787782022.667853:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787782022.667860:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963057920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.667908:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963057920:12345-0@lo:400:kworker.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782022.667914:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787782022.667926:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787782022.667933:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963058304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.667980:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963058304:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782022.667987:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787782022.668031:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963057920:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.668062:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963058304:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.668099:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3660:1874624963057280:0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.668126:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058176 00000100:00100000:1.0:1787782022.668137:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058176 00000100:00100000:1.0:1787782022.668169:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787782022.668175:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963058176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782022.668212:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874624963058176:12345-0@lo:400:kworker.0 Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782022.668217:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00080000:1.0:1787782022.668244:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a6d00 x1874624963058176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782022.668256:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963058176:0@lo:400:kworker.0 00000100:00080000:1.0:1787782022.668284:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787782022.668289:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782022.668291:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782022.670851:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963057408:12345-0@lo:38:kworker.0 Request processed in 8243us (8370us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782022.670865:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787782022.676428:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782022.676516:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963058048:0@lo:38:kworker.0 00000100:00100000:2.0:1787782022.676558:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787782022.676636:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782022.676642:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782022.676647:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963057408:0@lo:38:kworker.0 00000100:00080000:2.0:1787782022.676673:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782022.676677:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782022.676680:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963057536:0@lo:38:kworker.0 00000100:00100000:3.0:1787782022.676874:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057664 00000100:00100000:3.0:1787782022.676883:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057664 00000100:00100000:3.0:1787782022.676985:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058048 00000100:00100000:3.0:1787782022.676989:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058048 00000100:00100000:3.0:1787782022.677012:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787782022.677021:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963057664:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787782022.677043:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787782022.677105:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787782022.677112:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1874624963058048:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787782022.677122:0:6532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782022.677320:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963057664:12345-0@lo:38:kworker.0 Request processed in 297us (902us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782022.677329:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787782022.677465:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782022.677541:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963057792 00000100:00100000:3.0:1787782022.677552:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963057792 00000100:00100000:3.0:1787782022.677693:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787782022.677701:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963057792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782022.677777:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963057792:12345-0@lo:400:kworker.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782022.677784:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787782022.679237:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1874624963058048:12345-0@lo:38:kworker.0 Request processed in 2114us (2668us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782022.679250:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:1.0:1787782022.679339:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a43c0 x1874624963057792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782022.679351:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963057792:0@lo:400:kworker.0 00000100:00080000:0.0:1787782022.682087:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787782022.682208:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782022.682244:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782022.682250:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963057664:0@lo:38:kworker.0 00000100:00080000:3.0:1787782022.682364:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782022.682369:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787782022.682372:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963058048:0@lo:38:kworker.0 00000100:00100000:2.0:1787782023.176846:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782023.176877:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963058432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782023.176974:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782023.177220:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058432 00000100:00100000:0.0:1787782023.177229:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058432 00000100:00100000:0.0:1787782023.177288:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787782023.177307:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963058432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782023.177344:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787782023.177407:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963058432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782023.177415:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787782023.177511:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963058432:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787782023.237955:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782023.686056:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963058560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787782023.686159:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782023.688048:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058560 00000100:00100000:1.0:1787782023.688069:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058560 00000100:00100000:1.0:1787782023.688251:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787782023.688267:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963058560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782023.688336:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787782023.688440:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963058560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782023.688448:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787782023.688568:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963058560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787782024.264132:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782025.288478:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782026.309899:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782027.334120:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782027.782016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782027.782023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782027.782026:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782027.782033:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787782027.782039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782027.782045:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff993d679fd800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782027.782068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4000 x1874624963058816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782027.782084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782027.782087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782027.782089:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782027.782092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787782027.782095:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782027.782099:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff993d78ce4000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782027.782112:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a6940 x1874624963058944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782027.782121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782027.782140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782027.782142:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782027.782146:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787782027.782150:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782027.782154:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782027.782169:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a43c0 x1874624963059072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782027.782200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782027.782203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782027.782205:0:36:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782027.782208:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787782027.782211:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782027.782214:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782027.782225:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a6d00 x1874624963059456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782027.782299:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963059328:0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.782366:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782027.782429:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782027.782437:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963059584:0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.782461:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782027.782488:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963058688:0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.782493:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059328 00000100:00100000:0.0:1787782027.782513:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059328 00000100:00100000:2.0:1787782027.782525:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782027.782559:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963059712:0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.782574:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787782027.782587:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963059328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782027.782588:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782027.782775:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963059328:12345-0@lo:400:kworker.0 Request processed in 192us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782027.782789:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787782027.782803:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059712 00000100:00100000:0.0:1787782027.782817:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059712 00000100:00100000:0.0:1787782027.782845:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787782027.782852:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963059712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.782882:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963059712:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782027.782888:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1787782027.782898:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782027.782903:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782027.782918:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963059328:0@lo:400:kworker.0 00000100:00100000:1.0:1787782027.782920:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058688 00000100:00100000:1.0:1787782027.782923:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058688 00000100:00100000:1.0:1787782027.782949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787782027.782956:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624963058688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782027.782989:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d728d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f49034a-383c-4a58-b5dc-1e0e9271edf7+19:3659:x1874624963058688:12345-0@lo:400:kworker.0 Request processed in 34us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782027.782995:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1787782027.786166:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963059200:0@lo:400:kworker.0 00000100:00100000:3.0:1787782027.786260:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782027.786338:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963058816:0@lo:38:kworker.0 00000100:00100000:3.0:1787782027.786366:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782027.786471:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963058944:0@lo:38:kworker.0 00000100:00100000:2.0:1787782027.786511:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963059712:0@lo:400:kworker.0 00000100:00100000:0.0:1787782027.786536:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059584 00000100:00100000:0.0:1787782027.786549:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059584 00000100:00100000:0.0:1787782027.786602:0:10060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059200 00000100:00100000:0.0:1787782027.786631:0:10060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059200 00000100:00100000:0.0:1787782027.786658:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787782027.786666:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963059584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782027.787037:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058816 00000100:00100000:1.0:1787782027.787043:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058816 00000100:00100000:1.0:1787782027.787068:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787782027.787073:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963058816:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787782027.787087:0:6536:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782027.787415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782027.787439:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963059072:0@lo:38:kworker.0 00000100:00100000:3.0:1787782027.787466:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782027.787491:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963059456:0@lo:38:kworker.0 00000100:00100000:3.0:1787782027.787512:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782027.787555:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963058944 00000100:00100000:3.0:1787782027.787559:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963058944 00000100:00100000:3.0:1787782027.787574:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059072 00000100:00100000:3.0:1787782027.787576:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059072 00000100:00100000:3.0:1787782027.787583:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059456 00000100:00100000:3.0:1787782027.787584:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059456 00000100:00100000:3.0:1787782027.787593:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787782027.787602:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782027.789840:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963059200:12345-0@lo:400:kworker.0 Request processed in 2237us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782027.789841:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963058688:0@lo:400:kworker.0 00000100:00100000:3.0:1787782027.789858:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787782027.789891:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787782027.789897:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963058944:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787782027.789912:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787782027.789929:0:6533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787782027.789939:0:6533:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787782027.789950:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963058944:12345-0@lo:38:kworker.0 Request processed in 52us (2534us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782027.789958:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787782027.789973:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787782027.789977:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963059072:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787782027.789985:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782027.790026:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963059072:12345-0@lo:38:kworker.0 Request processed in 47us (2559us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782027.790033:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787782027.790047:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787782027.790054:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963059456:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787782027.790062:0:6531:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787782027.790104:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963059456:12345-0@lo:38:kworker.0 Request processed in 49us (2590us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782027.790109:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:3.0:1787782027.790146:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a7480 x1874624963059200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782027.790159:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963059200:0@lo:400:kworker.0 00000100:00080000:3.0:1787782027.790189:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782027.790194:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787782027.790198:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963058944:0@lo:38:kworker.0 00000100:00080000:3.0:1787782027.790209:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782027.790212:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787782027.790215:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963059072:0@lo:38:kworker.0 00000100:00080000:3.0:1787782027.790224:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782027.790228:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787782027.790231:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963059456:0@lo:38:kworker.0 00000100:00080000:3.0:1787782027.790285:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787782027.793121:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963059584:12345-0@lo:400:kworker.0 Request processed in 6447us (10649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782027.793138:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00080000:2.0:1787782027.793524:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c431a4780 x1874624963059584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782027.793541:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963059584:0@lo:400:kworker.0 00000100:00100000:1.0:1787782027.797555:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963058816:12345-0@lo:38:kworker.0 Request processed in 10472us (11180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782027.797568:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787782027.797754:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782027.797760:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782027.797765:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963058816:0@lo:38:kworker.0 00000100:00100000:2.0:1787782028.293978:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782028.294000:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963059840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782028.294070:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782028.294223:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059840 00000100:00100000:0.0:1787782028.294232:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059840 00000100:00100000:0.0:1787782028.296860:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787782028.296891:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963059840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782028.296926:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787782028.297017:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963059840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (2946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782028.297025:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787782028.297139:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963059840:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787782028.357821:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782028.422386:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787782028.805892:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963059968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782028.805974:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782028.806090:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963059968 00000100:00100000:2.0:1787782028.806097:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963059968 00000100:00100000:2.0:1787782028.806165:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787782028.806174:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963059968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787782028.806204:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787782028.806254:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963059968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782028.806261:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787782028.806524:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963059968:0@lo:13:osp-pre-0-1.0 00000020:02000400:1.0:1787782029.317739:0:15218:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:1.0:1787782029.333696:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c43644600 - data ffff993c420eeaf8/ffff993c436db800 00000020:01000000:1.0:1787782029.333955:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993d49c7c120 - data ffff993d6500b360/ffff993d46fb9800 00000001:00000004:1.0:1787782029.340075:0:15218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:3.0:1787782029.384487:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782029.399913:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782029.399923:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787782029.399937:0:15218:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff993c43fd83c0 x1874624963054848/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787782024 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782029.399963:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787782029.403022:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787782029.403031:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1787782029.403089:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787782029.403092:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787782029.405965:0:8635:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787782029.405973:0:8635:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787782029.405986:0:8635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787782029.406534:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787782029.406539:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787782029.407182:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782029.407197:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787782029.408705:0:9839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787782029.408711:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787782029.408732:0:9839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787782029.411122:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062e8e 00000020:00000080:3.0:1787782029.411135:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d5eaec000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787782029.411345:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eaec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782029.414987:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062ea3 00000020:00000080:3.0:1787782029.415001:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d725f4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787782029.415014:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787782029.415019:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782029.415027:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787782029.415030:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff993d725db370) has no exports 00000004:01000000:3.0:1787782029.415190:0:15218:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787782029.415198:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150632d9 00000020:00000080:3.0:1787782029.415203:0:15218:0:(genops.c:885:class_export_put()) final put ffff993c4346f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787782029.415207:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787782029.415210:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782029.415218:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782029.415220:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff993c437e19b8) has no exports 00000020:00000080:3.0:1787782029.415226:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150632d2 00000020:00000080:3.0:1787782029.415230:0:15218:0:(genops.c:885:class_export_put()) final put ffff993c43c2f800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787782029.415572:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787782029.415577:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787782029.415581:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787782029.415586:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782029.415588:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782029.415634:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782029.415642:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787782029.415647:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063197 00000020:00000080:3.0:1787782029.415652:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d7c449000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787782029.415656:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787782029.415659:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782029.415663:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782029.415665:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff993d770dcd28) has no exports 00000020:00000080:3.0:1787782029.415670:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063190 00000020:00000080:3.0:1787782029.415672:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d7c44a800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787782029.416000:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787782029.416003:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787782029.416006:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787782029.416010:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782029.416011:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782029.416035:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782029.416041:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787782029.416050:0:15218:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787782029.416055:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063047 00000020:00000080:3.0:1787782029.416061:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d67eb0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787782029.416064:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787782029.416068:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782029.416072:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782029.416075:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff993d770d99b8) has no exports 00000020:00000080:3.0:1787782029.416079:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063040 00000020:00000080:3.0:1787782029.416082:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d77185800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787782029.416871:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787782029.416885:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c4346f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787782029.416895:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c43c2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787782029.416900:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c43c28800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787782029.416907:0:14356:0:(genops.c:885:class_export_put()) final put ffff993c437f4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787782029.416909:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993c437f4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787782029.416915:0:14356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782029.416985:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7c449000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787782029.416989:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7c44a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787782029.416993:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d7c44c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787782029.416997:0:14356:0:(genops.c:885:class_export_put()) final put ffff993d7c44c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787782029.417005:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7c44c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787782029.417008:0:14356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782029.417032:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67eb0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787782029.417035:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d77185800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787782029.418076:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787782029.418082:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782029.418085:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787782029.418091:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787782029.418143:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782029.418154:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782029.418177:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782029.418180:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782029.418184:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d46fd6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787782029.418187:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff993d46fd6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787782029.418192:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782029.418260:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062eaa 00000020:00000080:2.0:1787782029.418276:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d725f6800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787782029.418281:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787782029.418284:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782029.418288:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787782029.418291:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff993d725d8000) has no exports 00000020:00000080:2.0:1787782029.418309:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782029.418312:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787782029.418315:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062eb1 00000020:00000080:2.0:1787782029.418318:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d725f2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787782029.418325:0:15218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d47267800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787782029.418328:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d47267800 3 00000020:01000004:2.0:1787782029.418330:0:15218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff993d47267800 from lustre-MDT0000 00000020:00000080:2.0:1787782029.418348:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782029.418351:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787782029.418373:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d5eaed800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787782029.418375:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eaed800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787782029.418381:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787782029.418410:0:15218:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787782029.418414:0:15218:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787782029.418416:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787782029.418418:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782029.418421:0:15218:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787782029.418426:0:15218:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff993d5ebe3800 2f49034a-383c-4a58-b5dc-1e0e9271edf7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787782029.418431:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff993d5ea93370) has exports, disconnecting them 00000020:00080000:2.0:1787782029.418435:0:15218:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff993d5ebe3800), last request at 1787781762 00000020:00000080:2.0:1787782029.418558:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062e4f 00000020:00010000:2.0:1787782029.418563:0:15218:0:(genops.c:1921:obd_stale_export_put()) Put export ffff993d5ebe3800: total 2 00000100:00080000:2.0:1787782029.418567:0:15218:0:(import.c:65:import_set_state_nolock()) ffff993d5ebe7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787782029.418580:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d5ebe3800): rc 0 00000020:00080000:2.0:1787782029.418583:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff993d5ea93370) has no exports 00000100:00100000:0.0:1787782029.418696:0:6526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff993d49f39200:6526] 2 exiting: rc = 0 00000020:00000080:0.0:1787782029.418782:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d77184000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787782029.418788:0:14356:0:(genops.c:885:class_export_put()) final put ffff993d725f1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782029.418790:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787782029.418793:0:14356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782029.418843:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787782029.418847:0:14356:0:(genops.c:885:class_export_put()) final put ffff993d5eac0000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787782029.418848:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eac0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787782029.418852:0:14356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787782029.418889:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d725f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787782029.418924:0:6525:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff993d50e37a00:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1787782029.418988:0:6523:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff993d58a4f000:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1787782029.419700:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419707:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419723:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419730:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419735:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419741:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419747:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419755:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419761:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419767:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419773:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419779:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419785:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419792:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419798:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419803:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419808:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419824:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419833:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419839:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419844:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419849:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419854:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419860:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419865:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419880:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419886:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419891:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419896:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419901:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419906:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419910:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419915:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419920:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419925:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419929:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419934:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419939:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419943:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419948:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419952:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419957:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419962:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419967:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419971:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419976:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419981:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419985:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419989:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419995:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.419999:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420004:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420016:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420021:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420026:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420031:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420037:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420042:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420058:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420064:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420069:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420077:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420086:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782029.420095:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1787782029.421970:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d4150f000/0xc6d6745c15062f4b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15062f44 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.421994:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150f000/0xc6d6745c15062f4b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15062f44 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422010:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d41480200/0xc6d6745c15063350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063349 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422020:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480200/0xc6d6745c15063350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063349 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422030:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d773f8200/0xc6d6745c1506335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063357 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422038:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8200/0xc6d6745c1506335e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063357 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422046:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d773f9000/0xc6d6745c1506336c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063365 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422071:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9000/0xc6d6745c1506336c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063365 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422079:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d43039800/0xc6d6745c1506337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063373 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422087:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039800/0xc6d6745c1506337a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063373 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422096:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d41480e00/0xc6d6745c15063388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063381 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422104:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480e00/0xc6d6745c15063388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063381 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422111:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d41480c00/0xc6d6745c15063396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c1506338f expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422117:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d41480c00/0xc6d6745c15063396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c1506338f expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422124:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d4150ec00/0xc6d6745c150633c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c150633b9 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422131:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d4150ec00/0xc6d6745c150633c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c150633b9 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422142:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d43038600/0xc6d6745c15063270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063269 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422162:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43038600/0xc6d6745c15063270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063269 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422190:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d82166600/0xc6d6745c15062f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15062f52 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422198:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166600/0xc6d6745c15062f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15062f52 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422209:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993c43704a00/0xc6d6745c150635f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c150635e9 expref: 4 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422217:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43704a00/0xc6d6745c150635f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c150635e9 expref: 4 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422224:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d412e5e00/0xc6d6745c150635fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c150635f7 expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422231:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e5e00/0xc6d6745c150635fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c150635f7 expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422238:0:15218:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff993d43039200/0xc6d6745c1506360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xc6d6745c15063605 expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782029.422246:0:15218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d43039200/0xc6d6745c1506360c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xc6d6745c15063605 expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787782029.423654:0:10349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff993d5ebe3800: total 0 00010000:00010000:2.0:1787782029.423711:0:10349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff993d5ebe3800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1787782029.423737:0:10349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff993d5ebe3800, canceled 0 locks, left on hash table 0. 00000020:00000080:2.0:1787782029.423758:0:10349:0:(genops.c:885:class_export_put()) final put ffff993d5ebe3800/2f49034a-383c-4a58-b5dc-1e0e9271edf7 00010000:00010000:2.0:1787782029.423780:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782029.423782:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782029.423785:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782029.423903:0:14356:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5ebe3800/2f49034a-383c-4a58-b5dc-1e0e9271edf7 for MGS 00000020:00000080:0.0:1787782029.423941:0:14356:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d5ebe7000 for MGS 00010000:00010000:3.0:1787782030.406225:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782031.429966:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787782031.430931:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c434b3e40 - data ffff993c42015870/ffff993c437cc800 00000020:01000000:2.0:1787782031.431082:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993d50e85480 - data ffff993d650dbe58/ffff993d80a38c00 00000020:00000080:2.0:1787782031.431565:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062e33 00000020:00000080:2.0:1787782031.431960:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d47258800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787782031.432090:0:15218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d47267800 from MGS, refs=2 00000020:01000004:2.0:1787782031.432094:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d47267800 2 00000020:01000004:2.0:1787782031.432097:0:15218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff993d47267800 from MGS 00000020:00000080:2.0:1787782031.432121:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782031.432128:0:15218:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787782031.432131:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d4725e000/MGS 00000020:00000080:2.0:1787782031.432134:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff993d4725e000/MGS for MGS 00000020:01000000:2.0:1787782031.432140:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787782031.432201:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787782031.432308:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782031.432314:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787782031.432321:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff993d80a11000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787782031.432327:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff993d770d8000) has exports, disconnecting them 00000020:00080000:2.0:1787782031.432331:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff993d80a11000), last request at 1787781762 00000020:00000080:2.0:1787782031.432336:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062efe 00000020:00080000:2.0:1787782031.432347:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d80a11000): rc 0 00000020:00000080:2.0:1787782031.432448:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d80a11000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787782031.432474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d47258800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782031.441368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d80a11000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787782031.441397:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787782031.441401:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787782031.441405:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787782031.441411:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782031.441583:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782031.441591:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787782031.441598:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d47267800 1 00000020:00000080:3.0:1787782031.441604:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062e25 00000020:00000080:3.0:1787782031.441641:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d4725d000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787782031.441646:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787782031.441651:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782031.441665:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787782031.441668:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff993d5ea919b8) has no exports 00000020:00000080:0.0:1787782031.445938:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d77184800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787782031.445953:0:36:0:(genops.c:885:class_export_put()) final put ffff993d5eac6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787782031.445957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eac6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787782031.445970:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787782031.446045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d4725d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787782031.494107:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782031.494119:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787782031.494125:0:15218:0:(genops.c:885:class_export_put()) final put ffff993d4725b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787782031.494129:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff993d4725b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787782031.494141:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787782031.494323:0:15218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff993d4725b800 00000020:02000400:1.0:1787782031.494391:0:15218:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787782032.454341:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787782032.903131:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782032.903139:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787782032.903143:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782032.903154:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787782032.903160:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787782032.903168:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff993d679fd800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782032.903192:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43edfc00 x1874624963060224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782032.903208:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782032.903212:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787782032.903213:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782032.903217:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787782032.903220:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787782032.903223:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff993d78ce4000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782032.903234:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43edf840 x1874624963060352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782032.903243:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782032.903246:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787782032.903248:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782032.903252:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787782032.903255:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787782032.903259:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782032.903271:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43edda40 x1874624963060480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782032.903324:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782032.903328:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787782032.903330:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782032.903334:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787782032.903336:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787782032.903340:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782032.903364:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43edde00 x1874624963060864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782032.903409:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963060736:0@lo:400:kworker.0 00000100:00100000:3.0:1787782032.903497:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782032.903567:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782032.903574:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963060608:0@lo:400:kworker.0 00000100:00100000:3.0:1787782032.903635:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.903816:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963060992:0@lo:400:kworker.0 00000100:00100000:2.0:1787782032.903855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.903884:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787782032.903891:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963060096:0@lo:400:kworker.0 00000400:00000100:2.0:1787782032.903914:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874624963060096 offset 0 length 224: 4 00000100:00100000:2.0:1787782032.903956:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963061120:0@lo:400:kworker.0 00000100:00100000:2.0:1787782032.903981:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.904007:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963060224:0@lo:38:kworker.0 00000100:00100000:2.0:1787782032.904036:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.904056:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963060352:0@lo:38:kworker.0 00000100:00100000:2.0:1787782032.904079:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.904096:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963060480:0@lo:38:kworker.0 00000100:00100000:2.0:1787782032.904118:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.904137:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963060864:0@lo:38:kworker.0 00000100:00100000:2.0:1787782032.904156:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782032.904206:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060608 00000100:00100000:2.0:1787782032.904215:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060608 00000100:00100000:2.0:1787782032.904273:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060992 00000100:00100000:2.0:1787782032.904277:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060992 00000100:00100000:2.0:1787782032.904293:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060352 00000100:00100000:2.0:1787782032.904295:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060352 00000100:00100000:2.0:1787782032.904304:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060480 00000100:00100000:2.0:1787782032.904307:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060480 00000100:00100000:2.0:1787782032.904315:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060864 00000100:00100000:2.0:1787782032.904318:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060864 00000100:00100000:2.0:1787782032.904329:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787782032.904338:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963060608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782032.904534:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963060608:12345-0@lo:400:kworker.0 Request processed in 197us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782032.904541:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787782032.904556:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787782032.904562:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787782032.904567:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963060352:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787782032.904567:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963060992:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1787782032.904598:0:6533:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787782032.904632:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874624963060992:12345-0@lo:400:kworker.0 Request processed in 68us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782032.904639:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787782032.904655:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963060352:12345-0@lo:38:kworker.0 Request processed in 86us (575us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787782032.904656:0:10060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787782032.904660:0:10060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1874624963060480:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787782032.904662:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00020000:0.0:1787782032.904670:0:10060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787782032.904672:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787782032.904675:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963060864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787782032.904683:0:6533:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787782032.904692:0:10060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1874624963060480:12345-0@lo:38:kworker.0 Request processed in 31us (573us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787782032.904710:0:10060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787782032.904715:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963060864:12345-0@lo:38:kworker.0 Request processed in 39us (558us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787782032.904721:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787782032.904737:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060224 00000100:00100000:2.0:1787782032.904740:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060224 00010000:00080000:0.0:1787782032.904749:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff993c43edd2c0 x1874624963060992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782032.904758:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787782032.904763:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963060224:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787782032.904764:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963060992:0@lo:400:kworker.0 00010000:00020000:2.0:1787782032.904772:0:6537:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787782032.904798:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963060224:12345-0@lo:38:kworker.0 Request processed in 34us (762us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787782032.904804:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:2.0:1787782032.904826:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787782032.904849:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782032.904854:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782032.904857:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963060224:0@lo:38:kworker.0 00000100:00080000:2.0:1787782032.904865:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782032.904868:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782032.904871:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963060352:0@lo:38:kworker.0 00000100:00080000:2.0:1787782032.904887:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782032.904890:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782032.904893:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963060480:0@lo:38:kworker.0 00000100:00080000:2.0:1787782032.904901:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782032.904904:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782032.904906:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963060864:0@lo:38:kworker.0 00010000:00080000:2.0:1787782032.905079:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff993c43edf0c0 x1874624963060608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782032.905090:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963060608:0@lo:400:kworker.0 00000100:00100000:1.0:1787782032.905181:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963060736 00000100:00100000:1.0:1787782032.905186:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963060736 00000100:00100000:1.0:1787782032.905236:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061120 00000100:00100000:1.0:1787782032.905239:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061120 00000100:00100000:1.0:1787782032.905260:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787782032.905268:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963060736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782032.905315:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963060736:12345-0@lo:400:kworker.0 Request processed in 49us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782032.905322:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787782032.905336:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787782032.905342:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782032.905389:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963061120:12345-0@lo:400:kworker.0 Request processed in 48us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782032.905396:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787782032.905447:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963061120:0@lo:400:kworker.0 00000100:00100000:1.0:1787782032.905471:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963060736:0@lo:400:kworker.0 00000100:00080000:2.0:1787782032.905671:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782032.905676:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782033.414864:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963061248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787782033.415132:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782033.415268:0:10768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061248 00000100:00100000:0.0:1787782033.415279:0:10768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061248 00000100:00100000:0.0:1787782033.415344:0:10768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787782033.415355:0:10768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963061248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782033.415391:0:10768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787782033.415450:0:10768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963061248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782033.415458:0:10768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787782033.415648:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963061248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787782033.482425:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782033.928825:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963061376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787782033.928936:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782033.929044:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061376 00000100:00100000:1.0:1787782033.929055:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061376 00000100:00100000:1.0:1787782033.929113:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787782033.929123:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963061376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782033.929162:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787782033.929214:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963061376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782033.929222:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787782033.929278:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963061376:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787782034.504296:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782035.527711:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787782035.902337:0:15422:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787782035.912100:0:15422:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787782035.912186:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.912204:0:15422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.913998:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.914014:0:15422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.914041:0:15422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787782035.914048:0:15422:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787782035.914099:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782035.914105:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787782035.914815:0:15422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787782035.914823:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993d78ce4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787782035.914831:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782035.914832:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782035.915341:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787782035.921490:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921518:0:15422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921527:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921534:0:15422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921571:0:15422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782035.921597:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921604:0:15422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921634:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921641:0:15422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921670:0:15422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787782035.921688:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921697:0:15422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921703:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921710:0:15422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921723:0:15422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787782035.921729:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.921734:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787782035.921737:0:15422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.921745:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921755:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.921761:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038400 already unused, calling callback (ffffffffc121fc20) 00010000:00010000:0.0:1787782035.921765:0:15422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.921771:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782035.921776:0:15422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787782035.921782:0:15422:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1787782035.921788:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.921797:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782035.921803:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782035.921814:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787782035.921817:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:01000004:0.0:1787782035.921821:0:15422:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787782035.921826:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787782035.921831:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782035.921837:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787782035.921844:0:15422:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff993c431b2000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782035.921850:0:15422:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff993c41cc2800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782035.921856:0:15422:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff993d5ea619b8) has exports, disconnecting them 00000020:00080000:0.0:1787782035.921861:0:15422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff993c431b2000), last request at 1787782032 00000020:00000080:0.0:1787782035.921871:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063231 00000100:00080000:0.0:1787782035.921892:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993c431b6800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782035.921944:0:15422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c431b2000): rc 0 00000020:00000080:0.0:1787782035.921947:0:15422:0:(genops.c:885:class_export_put()) final put ffff993c431b2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787782035.921958:0:15422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff993c41cc2800), last request at 1787782032 00000020:00000080:0.0:1787782035.921961:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506310b 00000100:00080000:0.0:1787782035.921967:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993c41cc4800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782035.921972:0:15422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c41cc2800): rc 0 00000020:00000080:0.0:1787782035.921975:0:15422:0:(genops.c:885:class_export_put()) final put ffff993c41cc2800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787782035.921982:0:15422:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffabe280d7fae0 00000100:00080000:0.0:1787782035.922009:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782035.922029:0:15422:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff993d44eb5a40 x1874624963056512/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787782033 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782035.922056:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1787782035.922065:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922074:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782035.922098:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922107:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038400/0xc6d6745c15063381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922123:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787782035.922127:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922191:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782035.922257:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922265:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.922271:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782035.922276:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782035.922278:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787782035.922280:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787782035.922295:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922312:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782035.922383:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922390:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9200/0xc6d6745c1506338f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063396 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922400:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787782035.922403:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922409:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782035.922412:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922418:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.922424:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782035.922429:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782035.922431:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787782035.922433:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787782035.922446:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922452:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782035.922469:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922486:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9c00/0xc6d6745c15063269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15063270 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922501:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782035.922504:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922511:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782035.922514:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922522:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.922528:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782035.922534:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787782035.922536:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787782035.922538:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787782035.922552:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922558:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782035.922565:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922571:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c15063605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c1506360c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922595:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782035.922599:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922629:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782035.922633:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922640:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782035.922646:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782035.922651:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782035.922653:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787782035.922655:0:10349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787782035.922668:0:10349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922674:0:10349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782035.922691:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922697:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15062f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6d6745c15062f59 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782035.922711:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782035.922713:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782035.922722:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787782035.922735:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c431b2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787782035.922794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41cc2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787782035.923047:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c431b6800 for lustre-MDT0001 00000020:00000080:2.0:1787782035.923053:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c41cc4800 for lustre-MDT0001 00000100:00100000:2.0:1787782035.923079:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963061760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782035.923185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782035.923390:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782035.923399:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963061888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782035.923406:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782035.923415:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782035.923433:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963061504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782035.923434:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782035.923476:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782035.923495:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061760 00000100:00100000:3.0:1787782035.923499:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963062016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782035.923505:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061760 00000100:00100000:3.0:1787782035.923520:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782035.923543:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782035.923544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061888 00000100:00100000:2.0:1787782035.923549:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061888 00000100:00100000:3.0:1787782035.923551:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963061632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782035.923562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061504 00000100:00100000:2.0:1787782035.923566:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061504 00000100:00100000:3.0:1787782035.923576:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782035.923579:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963062016 00000100:00100000:2.0:1787782035.923582:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963062016 00000100:00100000:2.0:1787782035.923594:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963061632 00000100:00100000:2.0:1787782035.923598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963061632 00000100:00100000:2.0:1787782035.923642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787782035.923650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3659:x1874624963061760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787782035.923657:0:6518:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782035 with bad export cookie 14327767203364351567 00000100:00100000:3.0:1787782035.923800:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787782035.923807:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d1bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3659:x1874624963061888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787782035.923812:0:9533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782035 with bad export cookie 14327767203364351567 00000100:00100000:3.0:1787782035.923869:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d1bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3659:x1874624963061888:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (435us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787782035.923876:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787782035.923898:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782035.923902:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963061504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787782035.923905:0:9533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782035 with bad export cookie 14327767203364351567 00000100:00100000:3.0:1787782035.923936:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963061504:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (460us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787782035.923940:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782035.923952:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787782035.923956:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963062016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787782035.923960:0:9533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782035 with bad export cookie 14327767203364351567 00000100:00100000:3.0:1787782035.923983:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963062016:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (463us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787782035.924138:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963056512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787782035.924171:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782035.926180:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787782035.926226:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782035.926235:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963061632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787782035.926243:0:9533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782035 with bad export cookie 14327767203364351567 00000100:00100000:3.0:1787782035.926328:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3657:x1874624963061632:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (2751us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787782035.926592:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787782035.929281:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787782035.929290:0:3659:0:(import.c:65:import_set_state_nolock()) ffff993d4736b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787782035.929314:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787782035.934722:0:15422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787782035.934753:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993d679fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787782035.935161:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787782035.935166:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787782035.935187:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787782035.935249:0:15422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787782035.935287:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993c426a9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787782035.935318:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787782035.935321:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1787782035.935328:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787782035.935388:0:15422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787782035.935397:0:15422:0:(import.c:65:import_set_state_nolock()) ffff993c437f1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787782035.935425:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff993d5ea619b8) has no exports 00000100:00100000:0.0:1787782035.936795:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963062144:0@lo:9:umount.0 00000100:00100000:0.0:1787782035.937237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782035.937295:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963062272:0@lo:9:umount.0 00000100:00100000:0.0:1787782035.937320:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782035.937370:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963062144 00000100:00100000:0.0:1787782035.937379:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963062144 00000100:00100000:0.0:1787782035.937443:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963062272 00000100:00100000:0.0:1787782035.937447:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963062272 00000100:00100000:0.0:1787782035.937470:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787782035.937480:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874624963062144:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787782035.937688:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787782035.937699:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874624963062272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787782035.937730:0:8445:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506329a 00000100:00080000:1.0:1787782035.937929:0:8445:0:(import.c:65:import_set_state_nolock()) ffff993c426ae000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787782035.938038:0:8447:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063158 00000100:00080000:0.0:1787782035.938045:0:8447:0:(import.c:65:import_set_state_nolock()) ffff993c41fae800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787782035.938063:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:0.0:1787782035.938091:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787782035.938323:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3656:x1874624963062272:12345-0@lo:9:umount.0 Request processed in 625us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782035.938332:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787782035.939470:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.116@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787782035.939478:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787782035.939490:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43ede1c0 x1874624963060096/t0(0) o400->MGC192.168.206.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787782048 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782035.939508:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993d67fda1c0 x1874624963061760/t0(0) o103->MGC192.168.206.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782051 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782035.939729:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3656:x1874624963062144:12345-0@lo:9:umount.0 Request processed in 2245us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782035.939742:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787782035.939817:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c426a9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787782035.940012:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993d67fd83c0 x1874624963061888/t0(0) o103->MGC192.168.206.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782051 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782035.940022:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fd83c0 x1874624963061504/t0(0) o103->MGC192.168.206.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782051 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782035.940030:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993d67fdb0c0 x1874624963062016/t0(0) o103->MGC192.168.206.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782051 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782035.940038:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fd9e00 x1874624963061632/t0(0) o103->MGC192.168.206.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782051 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787782035.940087:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787782035.940091:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787782035.940092:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787782035.940095:0:3659:0:(import.c:65:import_set_state_nolock()) ffff993d4736b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782035.940101:0:3659:0:(import.c:510:import_select_connection()) MGC192.168.206.116@tcp: connect to NID 0@lo last attempt 199 00000100:00080000:3.0:1787782035.940110:0:3659:0:(import.c:624:import_select_connection()) MGC192.168.206.116@tcp: import ffff993d4736b800 using connection 192.168.206.116@tcp/0@lo 00010000:00010000:3.0:1787782035.940129:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782035.940161:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963061632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782035.940170:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963061504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782035.940176:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963062016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782035.940185:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3657:1874624963060096:0@lo:400:kworker.0 00000004:00080000:0.0:1787782035.940357:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787782035.940363:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782035.940369:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963062144:0@lo:9:umount.0 00000100:00080000:0.0:1787782035.940399:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c437f1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787782035.940412:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787782035.940415:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782035.940418:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963062272:0@lo:9:umount.0 00000100:00100000:3.0:1787782035.940654:0:3659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43fe2940 x1874624963062400/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782035.940704:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624963062400:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787782035.940749:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874624963062400 offset 0 length 520: 4 00000100:00100000:3.0:1787782035.941147:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963061760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782035.941164:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3659:1874624963061888:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787782035.946713:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782035.946728:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787782035.949019:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787782035.949130:0:6518:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874624963061760 offset 224 length 224: 4 00000100:00100000:2.0:1787782035.949166:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3659:x1874624963061760:12345-0@lo:103:ldlm_bl.0 Request processed in 25513us (25979us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787782035.949181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:1.0:1787782035.974049:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff993d5ea619b8) has no exports 00000020:01000000:2.0:1787782036.042023:0:15422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c434b3960 - data ffff993c420c2510/ffff993d67fa1400 00000020:01000000:2.0:1787782036.042542:0:15422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993d50e854e0 - data ffff993d651f41b0/ffff993d67cfb000 00000001:00000004:2.0:1787782036.065195:0:15422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787782036.129034:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782036.129059:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787782036.129070:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787782036.134012:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787782036.134024:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787782036.134055:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782036.134059:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787782036.134859:0:8627:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787782036.134867:0:8627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787782036.134883:0:8627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787782036.135635:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787782036.135640:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1787782036.135656:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782036.135659:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787782036.136190:0:9835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787782036.136196:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787782036.136211:0:9835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787782036.137455:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f75 00000020:00000080:3.0:1787782036.137471:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d7236a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787782036.142976:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f8a 00000020:00000080:3.0:1787782036.143000:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d78ce6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787782036.144870:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7236a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787782036.145139:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787782036.145156:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782036.145169:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787782036.145175:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff993d5ea60000) has no exports 00000004:01000000:3.0:1787782036.145442:0:15422:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787782036.145455:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063293 00000020:00000080:3.0:1787782036.145465:0:15422:0:(genops.c:885:class_export_put()) final put ffff993c426a8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787782036.145472:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787782036.145488:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782036.145497:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782036.145500:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff993c437e0000) has no exports 00000020:00000080:3.0:1787782036.145508:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506328c 00000020:00000080:3.0:1787782036.145512:0:15422:0:(genops.c:885:class_export_put()) final put ffff993c437f1800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787782036.146733:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d78ce6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787782036.146914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426a8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787782036.146921:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c437f1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787782036.148387:0:15422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787782036.148398:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787782036.148403:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1787782036.148413:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782036.148415:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782036.148484:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782036.148502:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787782036.148513:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063151 00000020:00000080:3.0:1787782036.148526:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d7c44e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787782036.148534:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787782036.148543:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782036.148548:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782036.148553:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff993d770db370) has no exports 00000020:00000080:1.0:1787782036.148650:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c437f1000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787782036.148659:0:37:0:(genops.c:885:class_export_put()) final put ffff993d67ccd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787782036.148663:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67ccd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787782036.148671:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787782036.148704:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506314a 00000020:00000080:3.0:1787782036.148709:0:15422:0:(genops.c:885:class_export_put()) final put ffff993c426af000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787782036.148802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7c44e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787782036.148807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426af000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787782036.149156:0:15422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787782036.149161:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787782036.149164:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787782036.149169:0:15422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782036.149171:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782036.149214:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782036.149223:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787782036.149727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c426a9000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787782036.149741:0:36:0:(genops.c:885:class_export_put()) final put ffff993c426a8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787782036.149744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426a8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787782036.149751:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787782036.150814:0:15422:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787782036.150830:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062fad 00000020:00000080:3.0:1787782036.150839:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d46fd2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787782036.150860:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787782036.150868:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782036.150895:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782036.150900:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff993d5880cd28) has no exports 00000020:00000080:3.0:1787782036.150909:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062fa6 00000020:00000080:3.0:1787782036.150914:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d679fc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787782036.151405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d46fd2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787782036.151418:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d679fc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787782036.163037:0:15422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787782036.163060:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782036.163066:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787782036.163078:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782036.163162:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782036.163175:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787782036.163208:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782036.163212:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787782036.163220:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d7236c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787782036.163225:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7236c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787782036.163245:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787782036.163348:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d679fd800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787782036.163358:0:36:0:(genops.c:885:class_export_put()) final put ffff993d679ff800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787782036.163360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d679ff800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787782036.163364:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787782036.163458:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f91 00000020:00000080:0.0:1787782036.163466:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d78ce2000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787782036.163478:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787782036.163482:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782036.163487:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782036.163491:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff993d5ea63370) has no exports 00000020:00000080:1.0:1787782036.163495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d78ce2000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787782036.163590:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782036.163601:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787782036.163624:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d7236c000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787782036.163627:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7236c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787782036.163631:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787782036.163823:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f98 00000020:00000080:1.0:1787782036.163829:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d78ce6800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787782036.163853:0:15422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d80a11800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787782036.163856:0:15422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d80a11800 2 00000020:01000004:1.0:1787782036.163860:0:15422:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff993d80a11800 from lustre-MDT0001 00000020:00000080:1.0:1787782036.163880:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782036.163885:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787782036.163888:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d7236e000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787782036.163890:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7236e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787782036.163898:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:0.0:1787782036.163914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d78ce6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:1.0:1787782036.163924:0:15422:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787782036.163929:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787782036.163932:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782036.163936:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787782036.163945:0:15422:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff993d46f69000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787782036.163950:0:15422:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff993d67c419b8) has exports, disconnecting them 00000020:00080000:1.0:1787782036.163954:0:15422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff993d46f69000), last request at 1787781781 00000020:00000080:1.0:1787782036.163959:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062fec 00000020:00080000:1.0:1787782036.163971:0:15422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d46f69000): rc 0 00000020:00000080:1.0:1787782036.163976:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d46f69000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787782036.164008:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d46f69000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1787782036.165697:0:15422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1787782036.165708:0:15422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782036.165712:0:15422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787782036.165721:0:15422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782036.165765:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d78ce4000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787782036.166148:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782036.166159:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787782036.166165:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d78ce2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787782036.166170:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d78ce2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787782036.166177:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787782036.166267:0:15422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d80a11800 1 00000020:00000080:0.0:1787782036.166275:0:15422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062f28 00000020:00000080:0.0:1787782036.166282:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d773ee800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787782036.166294:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787782036.166304:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993d773ee800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787782036.166313:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782036.166319:0:15422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787782036.166322:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff993d5880b370) has no exports 00000020:00000080:3.0:1787782036.331718:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782036.331736:0:15422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787782036.331743:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d770b3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787782036.331749:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d770b3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787782036.331764:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787782036.331909:0:15422:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff993d80a13000 00000020:01000000:3.0:1787782036.331931:0:15422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787782036.331935:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782036.331940:0:15422:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787782036.331944:0:15422:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff993d5ea64d28) has no exports 00000100:00100000:0.0:1787782036.332253:0:10060:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff993c436ac000:10060] 3 exiting: rc = 0 00000100:00100000:3.0:1787782036.332444:0:6531:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff993d723cba00:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1787782036.332777:0:6532:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff993d723cb600:6532] 1 exiting: rc = 0 00000100:00100000:1.0:1787782036.332814:0:15221:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff993c43f34400:15221] 4 exiting: rc = 0 00000100:00100000:2.0:1787782036.333631:0:6533:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff993d50214c00:6533] 2 exiting: rc = 0 00000100:00100000:3.0:1787782036.333924:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333935:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333942:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333948:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333956:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333962:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333968:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333974:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333981:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333988:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.333994:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334000:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334007:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334013:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334019:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334025:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334031:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334037:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334064:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334070:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334076:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334082:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334088:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334094:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334100:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334106:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334111:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334117:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334123:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334129:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334135:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334140:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334146:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334153:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334158:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334165:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334172:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334178:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334183:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334188:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334194:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334199:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334204:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334210:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334230:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334237:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334243:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334249:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334255:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334261:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334268:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334274:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334280:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334293:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334299:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334305:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334311:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334316:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334321:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334326:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334332:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334338:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334343:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.334351:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.337972:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff993d809b5200:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1787782036.338204:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff993d50214000:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1787782036.338319:0:14286:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff993d50214200:14286] 2 exiting: rc = 0 00000100:00100000:0.0:1787782036.338434:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338444:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338451:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338457:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338513:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338519:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338526:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.338532:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339053:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339061:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339067:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339075:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339082:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339088:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339094:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339100:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339105:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339110:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339115:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339120:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339126:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339132:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339137:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339142:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339148:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339154:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339160:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339166:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339171:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339176:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339182:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339187:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339193:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339199:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339206:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339212:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339218:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339223:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339228:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339234:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339240:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339245:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339251:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339266:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339273:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339278:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339284:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339290:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339296:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339302:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339307:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339313:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339319:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339324:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339330:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339336:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339341:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339347:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339353:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339359:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339364:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339370:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339376:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.339381:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340049:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff993d6d1f2600:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1787782036.340157:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff993d6d1f2e00:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1787782036.340367:0:7892:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff993d67d0b800:7892] 2 exiting: rc = 0 00000100:00100000:1.0:1787782036.340492:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340502:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340525:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340533:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340542:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340560:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340578:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340586:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340593:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340599:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340663:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340671:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340689:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340695:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340702:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340708:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340714:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340720:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340742:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340750:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340757:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340765:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340771:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340778:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340785:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340794:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340801:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340808:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340814:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340821:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340854:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340862:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340868:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340889:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340895:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340917:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340925:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340943:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340949:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340956:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340963:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.340991:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341021:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341029:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341036:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341043:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341050:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341057:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341064:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341071:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341078:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341085:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341092:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341099:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341120:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341128:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341135:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341142:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341149:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341156:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341163:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341170:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341176:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782036.341182:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.351447:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff993d46534400:6539] 1 exiting: rc = 0 00000100:00100000:1.0:1787782036.351907:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff993d6d1f2a00:6538] 0 exiting: rc = 1 00000100:00100000:0.0:1787782036.352050:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352057:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352063:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352068:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352074:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352080:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352087:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352092:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352098:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352103:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352109:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352114:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352119:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352124:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352146:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352153:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352158:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352164:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352169:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352175:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352180:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352185:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352190:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352197:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352202:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352208:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352213:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352219:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352223:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352229:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352234:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352239:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352244:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352249:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352255:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352261:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352267:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352272:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352278:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352284:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352289:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352294:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352300:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352305:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352310:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352316:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352321:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352326:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352331:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352344:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352350:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352355:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352361:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352366:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352371:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352377:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352383:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352389:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352395:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352401:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352406:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352411:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352417:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352422:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.352939:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff993d5ea83200:6540] 0 exiting: rc = 1 00000100:00100000:3.0:1787782036.353111:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff993d5ea82200:6541] 1 exiting: rc = 0 00000100:00100000:0.0:1787782036.353212:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353220:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353226:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353232:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353238:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353244:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353250:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353254:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353260:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353265:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353271:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353277:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353282:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353288:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353294:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353299:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353304:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353309:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353315:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353332:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353337:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353342:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353347:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353353:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353358:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353363:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353369:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353374:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353380:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353385:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353391:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353397:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353403:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353408:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353414:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353419:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353425:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353431:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353436:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353441:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353446:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353452:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353458:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353464:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353469:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353475:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353481:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353488:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353493:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353498:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353504:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353510:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353515:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353520:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353534:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353539:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353544:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353550:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353556:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353561:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353566:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353598:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353627:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.353635:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782036.354184:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff993d72373200:6542] 0 exiting: rc = 1 00000100:00100000:1.0:1787782036.354371:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff993d80ad4400:6543] 1 exiting: rc = 0 00000100:00100000:0.0:1787782036.354425:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354432:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354438:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354445:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354451:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354457:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354463:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354469:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354475:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354481:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354487:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354494:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354499:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354505:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354511:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354516:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354522:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354529:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354536:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354542:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354547:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354733:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354743:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354749:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354754:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354773:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354778:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354784:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354789:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354795:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354800:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354805:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354810:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354816:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354822:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354828:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354833:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354839:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354845:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354850:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354855:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354861:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354866:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354871:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354876:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354882:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354887:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354893:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354898:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354902:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354908:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354913:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354918:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354923:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354928:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354933:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354938:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354943:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354948:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354953:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354966:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354971:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354976:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.354981:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782036.355780:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff993d5ea82600:6544] 0 exiting: rc = 1 00000100:00100000:1.0:1787782036.355818:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff993d72bf3a00:6546] 2 exiting: rc = 0 00000100:00100000:3.0:1787782036.356362:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff993d72bf2800:6545] 1 exiting: rc = 0 00000100:00100000:0.0:1787782036.356427:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356435:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356441:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356448:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356455:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356461:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356468:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356475:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356481:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356488:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356495:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356501:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356506:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356512:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356517:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356524:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356546:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356589:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356598:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356633:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356642:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356648:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356654:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356661:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356668:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356684:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356691:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356697:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356702:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356708:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356714:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356734:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356740:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356746:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356752:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356758:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356764:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356771:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356777:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356784:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356809:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356816:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356822:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356827:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356833:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356849:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356855:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356865:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356872:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356877:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356883:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356889:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356896:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356902:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356909:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356915:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356921:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356927:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356932:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356938:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356945:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356961:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356971:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782036.356978:0:15422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787782036.362368:0:15422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782036.362386:0:15422:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787782036.362412:0:15422:0:(genops.c:885:class_export_put()) final put ffff993d5eac0800/MDS_uuid 00000020:00000080:0.0:1787782036.362418:0:15422:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eac0800/MDS_uuid for MDS 00000020:01000000:0.0:1787782036.362425:0:15422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787782036.362994:0:15422:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787782036.552043:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782037.576715:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782038.022358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782038.022372:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782038.022376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782038.022379:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782038.022384:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782038.022395:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1787782038.022401:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787782038.022409:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d77182800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782038.022454:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a7480 x1874624963062528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782038.022528:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963062528:0@lo:38:kworker.0 00000400:00000100:2.0:1787782038.022593:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963062528 offset 0 length 520: 4 00000100:00080000:0.0:1787782038.023808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787782038.023814:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782038.023818:0:36:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782038.023834:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1787782038.023840:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787782038.023848:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c4346c800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782038.023870:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a6580 x1874624963062784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782038.027003:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963062656:0@lo:400:kworker.0 00000400:00000100:1.0:1787782038.027086:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963062656 offset 0 length 224: 4 00000100:00100000:2.0:1787782038.027998:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963062784:0@lo:38:kworker.0 00000400:00000100:2.0:1787782038.028036:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963062784 offset 0 length 520: 4 00000100:00100000:2.0:1787782038.028421:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963062912:0@lo:400:kworker.0 00000400:00000100:2.0:1787782038.028449:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963062912 offset 0 length 224: 4 00010000:00010000:3.0:1787782038.598823:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782039.623720:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782040.645887:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787782040.694419:0:15623:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787782040.715714:0:15623:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787782040.715770:0:15623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782040.715802:0:15623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782040.715810:0:15623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782040.715817:0:15623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782040.715841:0:15623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787782040.715847:0:15623:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787782040.715869:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782040.715879:0:15623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c431a7480 x1874624963062528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782040.715894:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787782040.715900:0:15623:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787782040.715905:0:15623:0:(import.c:65:import_set_state_nolock()) ffff993d77182800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787782040.715910:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782040.715913:0:15623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c431a7480 x1874624963062528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782063 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782040.715919:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782040.715922:0:15623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 30s for inflight to error out 00010000:00010000:1.0:1787782040.716034:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782040.716041:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782040.716049:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d41480600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787782040.716053:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782040.716061:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782040.716068:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782040.716073:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782040.716075:0:10348:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787782040.716077:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787782040.716088:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782040.716092:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782040.716098:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d41480600/0xc6d6745c15063365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506336c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782040.716107:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782040.716108:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782040.716110:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782040.716271:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963062528:0@lo:38:kworker.0 00000100:00080000:0.0:1787782040.717416:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787782040.717431:0:15623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c431a7c00 x1874624963062656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782054 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782040.717503:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787782040.717509:0:15623:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787782040.717541:0:15623:0:(import.c:65:import_set_state_nolock()) ffff993c41cc1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787782040.717965:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624963063040:0@lo:39:umount.0 00000400:00000100:2.0:1787782040.718017:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063040 offset 0 length 224: 4 00000100:00100000:1.0:1787782040.718173:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963062656:0@lo:400:kworker.0 00000100:00080000:3.0:1787782041.029914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782041.029924:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782041.029928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782041.029931:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782041.030053:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782041.030073:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963063168:0@lo:400:kworker.0 00000400:00000100:2.0:1787782041.030125:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063168 offset 0 length 224: 4 00010000:00010000:3.0:1787782041.675792:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787782042.120349:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787782042.120358:0:8439:0:(genops.c:885:class_export_put()) final put ffff993c41faa000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787782042.120465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41faa000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787782042.120509:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c41fae800 for lustre-OST0000 00000001:00100000:3.0:1787782042.122215:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787782042.122223:0:9524:0:(genops.c:885:class_export_put()) final put ffff993c426aa800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787782042.122308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426aa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787782042.122361:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c426ae000 for lustre-OST0001 00010000:00010000:2.0:1787782042.694649:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782043.077895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787782043.077921:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782043.077925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787782043.077928:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782043.078053:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782043.078074:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963063296:0@lo:400:kworker.0 00000400:00000100:1.0:1787782043.078133:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063296 offset 0 length 224: 4 00010000:00010000:3.0:1787782043.718219:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782044.742318:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782045.765895:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782045.829955:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782035/real 1787782035] req@ffff993c43fe2940 x1874624963062400/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782045.829990:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c43fe2940 x1874624963062400/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782045.830011:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4736b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782045.830094:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787782045.830099:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624963062400:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1787782045.833177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782045.833189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787782045.833196:0:36:0:(import.c:65:import_set_state_nolock()) ffff993d4736b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782045.833205:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.116@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1787782045.833211:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787782045.833219:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.116@tcp: import ffff993d4736b800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782045.833261:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43fe2940 x1874624963063424/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782045.833296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782045.833300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782045.833374:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782045.833489:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624963063424:0@lo:250:kworker.0 00000400:00000100:2.0:1787782045.833539:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874624963063424 offset 0 length 520: 4 00000100:00100000:0.0:1787782045.834909:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963063552:0@lo:400:kworker.0 00000400:00000100:0.0:1787782045.836560:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063552 offset 0 length 224: 4 00010000:00010000:2.0:1787782046.791035:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782047.813899:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782048.837981:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782049.861839:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782050.886144:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782050.949774:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782040/real 1787782040] req@ffff993c431a6940 x1874624963063040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782050 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782050.949806:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c431a6940 x1874624963063040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782050 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782050.949827:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c41cc1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787782050.949842:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624963063040:0@lo:39:umount.0 00000100:00080000:0.0:1787782050.951267:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787782050.951284:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782050.951290:0:15623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787782050.952259:0:15623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952275:0:15623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952282:0:15623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952289:0:15623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952320:0:15623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782050.952326:0:15623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952333:0:15623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952339:0:15623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952345:0:15623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782050.952829:0:15623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787782050.952836:0:15623:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787782050.952867:0:15623:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787782050.952872:0:15623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787782050.952877:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782050.952882:0:15623:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787782050.952887:0:15623:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff993d5ea90000) has no exports 00000020:00080000:0.0:1787782050.952908:0:15623:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff993d5ea90000) has no exports 00010000:00010000:1.0:1787782050.958416:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782050.958430:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958443:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704400 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787782050.958447:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958457:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782050.958464:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782050.958470:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782050.958473:0:10348:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787782050.958476:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787782050.958503:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782050.958507:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958513:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15063373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506337a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958528:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782050.958531:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958557:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038800 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787782050.958560:0:10348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958567:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782050.958572:0:10348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782050.958577:0:10348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787782050.958580:0:10348:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787782050.958582:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787782050.958588:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782050.958591:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958633:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038800/0xc6d6745c150635f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c150635fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782050.958644:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782050.958646:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782050.958648:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787782050.959062:0:15623:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c434233c0 - data ffff993d652cb000/ffff993c43757c00 00000020:01000000:0.0:1787782050.959176:0:15623:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993d50e85c60 - data ffff993d6529faf8/ffff993c4251c000 00010000:00010000:3.0:1787782050.959436:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787782050.972382:0:15623:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787782050.980885:0:15623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150630c5 00000020:00000080:3.0:1787782050.980901:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67fba800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787782050.980921:0:15623:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7236f800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787782050.980926:0:15623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7236f800 2 00000020:01000004:3.0:1787782050.980930:0:15623:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff993d7236f800 from lustre-OST0000 00000020:00000080:3.0:1787782050.980960:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782050.980973:0:15623:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787782050.980976:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67fb9800/lustre-OST0000_UUID 00000020:00000080:3.0:1787782050.980979:0:15623:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67fb9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787782050.980990:0:15623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787782050.981091:0:15623:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787782050.981097:0:15623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787782050.981102:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782050.981108:0:15623:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787782050.981116:0:15623:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff993d67b7f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787782050.981139:0:15623:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff993d58808000) has exports, disconnecting them 00000020:00080000:3.0:1787782050.981155:0:15623:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff993d67b7f800), last request at 1787781801 00000020:00000080:3.0:1787782050.981160:0:15623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150630ef 00000020:00080000:3.0:1787782050.981170:0:15623:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993d67b7f800): rc 0 00000020:00000080:3.0:1787782050.981176:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67b7f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782050.984715:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67fba800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787782050.984734:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67b7f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787782051.000930:0:15623:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787782051.000945:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782051.000970:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782051.001565:0:15623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787782051.001815:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d77182800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782051.002060:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782051.002073:0:15623:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787782051.002080:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67cce800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787782051.002085:0:15623:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67cce800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787782051.002115:0:15623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787782051.002216:0:15623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787782051.002221:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782051.002228:0:15623:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787782051.002237:0:15623:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff993c41cc3000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787782051.002244:0:15623:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff993d67c44d28) has exports, disconnecting them 00000020:00080000:1.0:1787782051.002249:0:15623:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff993c41cc3000), last request at 1787781801 00000020:00000080:1.0:1787782051.002254:0:15623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063104 00000020:00080000:1.0:1787782051.002273:0:15623:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c41cc3000): rc 0 00000020:00000080:1.0:1787782051.002279:0:15623:0:(genops.c:885:class_export_put()) final put ffff993c41cc3000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787782051.003130:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41cc3000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787782051.010282:0:15623:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787782051.010295:0:15623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782051.010300:0:15623:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782051.010311:0:15623:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787782051.010355:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c41cc1000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787782051.010641:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782051.010653:0:15623:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787782051.010659:0:15623:0:(genops.c:885:class_export_put()) final put ffff993c41cc6800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787782051.010664:0:15623:0:(genops.c:844:class_export_destroy()) destroying export ffff993c41cc6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787782051.010671:0:15623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787782051.010985:0:15623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7236f800 1 00000020:00000080:2.0:1787782051.010993:0:15623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506308d 00000020:00000080:2.0:1787782051.011001:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67fbc000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787782051.011014:0:15623:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787782051.011023:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67fbc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787782051.011033:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782051.011050:0:15623:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787782051.011055:0:15623:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff993d67c43370) has no exports 00000020:00000080:0.0:1787782051.098515:0:15623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782051.098534:0:15623:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787782051.098541:0:15623:0:(genops.c:885:class_export_put()) final put ffff993d67eb2800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787782051.098547:0:15623:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67eb2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787782051.098568:0:15623:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787782051.099212:0:15623:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff993d72368000 00000020:02000400:0.0:1787782051.099266:0:15623:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1787782051.336221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782051.336235:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782051.336238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782051.336242:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787782051.336306:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782051.336325:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963063680:0@lo:400:kworker.0 00000400:00000100:3.0:1787782051.336397:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063680 offset 0 length 224: 4 00010000:00010000:3.0:1787782051.911559:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782052.936322:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782053.957896:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787782054.406069:0:3659:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782038/real 1787782038] req@ffff993c431a43c0 x1874624963062912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782054.456237:0:3659:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff993c431a43c0 x1874624963062912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782054.456251:0:3659:0:(import.c:65:import_set_state_nolock()) ffff993c4346c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787782054.456255:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787782054.479893:0:3659:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1787782054.480005:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963062912:0@lo:400:kworker.0 00000100:00080000:3.0:1787782054.480206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782054.480211:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782054.480214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782054.480217:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782054.480220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782054.480223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787782054.480226:0:36:0:(import.c:65:import_set_state_nolock()) ffff993c4346c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782054.480232:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 259 00000100:00080000:3.0:1787782054.480242:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff993c4346c000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782054.480279:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43fe30c0 x1874624963063808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782054.480330:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624963063808:0@lo:38:kworker.0 00000400:00000100:3.0:1787782054.480392:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874624963063808 offset 0 length 520: 4 00010000:00010000:3.0:1787782054.984118:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782055.650592:0:15825:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787782055.670763:0:15825:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787782055.670875:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.670893:0:15825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.670925:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.670932:0:15825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.670969:0:15825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787782055.670976:0:15825:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787782055.671009:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782055.671023:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c431a6580 x1874624963062784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787782055.671100:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782055.671108:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782055.671116:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:1.0:1787782055.671120:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782055.671130:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782055.671138:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782055.671144:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782055.671147:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787782055.671150:0:6519:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787782055.671166:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782055.671178:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782055.671184:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43039c00/0xc6d6745c15063349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c15063350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782055.671196:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782055.671198:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782055.671200:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782055.680558:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787782055.680585:0:15825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787782055.680595:0:15825:0:(import.c:65:import_set_state_nolock()) ffff993c4346c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787782055.680604:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782055.680635:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c431a6580 x1874624963062784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782063 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.688869:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782055.691505:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963062784:0@lo:38:kworker.0 00000100:00100000:2.0:1787782055.692188:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787782055.695119:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782055.695144:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe3480 x1874624963063168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695213:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993d67fd9680 x1874624963063296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782059 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695233:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe1e00 x1874624963063552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695253:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe0780 x1874624963063680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695286:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe30c0 x1874624963063808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782064 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695302:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787782055.695309:0:15825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787782055.695316:0:15825:0:(import.c:65:import_set_state_nolock()) ffff993c4346c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787782055.695323:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782055.695326:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe3480 x1874624963063168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782057 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782055.695397:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963063296:0@lo:400:kworker.0 00000100:00100000:3.0:1787782055.695511:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1874624963063552:0@lo:400:kworker.0 00000100:00100000:0.0:1787782055.695545:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1874624963063168:0@lo:400:kworker.0 00000100:00100000:2.0:1787782055.695647:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993d67fd9680 x1874624963063296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782059 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695657:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe1e00 x1874624963063552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782061 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695664:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe0780 x1874624963063680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782067 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695681:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe30c0 x1874624963063808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787782064 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782055.695688:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787782055.695858:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963063680:0@lo:400:kworker.0 00000100:00100000:1.0:1787782055.695903:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624963063808:0@lo:38:kworker.0 00000100:00100000:2.0:1787782055.696180:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787782055.698129:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698154:0:15825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698164:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698193:0:15825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698273:0:15825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782055.698283:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698291:0:15825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698297:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782055.698304:0:15825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698336:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782055.698346:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698354:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038e00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782055.698359:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698434:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782055.698443:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782055.698450:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782055.698453:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787782055.698469:0:10349:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:0.0:1787782055.698543:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698550:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038e00/0xc6d6745c15063357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c1506335e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698578:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782055.698582:0:10349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698600:0:10349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782055.698603:0:10349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698747:0:10349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782055.698753:0:10349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782055.698758:0:10349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787782055.698760:0:10349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787782055.698764:0:10349:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:0.0:1787782055.698767:0:10349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782055.698774:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782055.698776:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782055.698778:0:10349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782055.699012:0:15825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787782055.699018:0:15825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43038c00/0xc6d6745c150635e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c150635f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782055.699036:0:15825:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787782055.699052:0:15825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787782055.699055:0:15825:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787782055.699096:0:15825:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787782055.699102:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787782055.699232:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782055.699241:0:15825:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787782055.699247:0:15825:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff993d67c40000) has no exports 00000020:00080000:3.0:1787782055.699277:0:15825:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff993d67c40000) has no exports 00010000:00010000:1.0:1787782055.701953:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787782055.703580:0:15825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c434b3420 - data ffff993d653406c0/ffff993d67fa3800 00000020:01000000:3.0:1787782055.704124:0:15825:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff993c434b3780 - data ffff993d653310d8/ffff993c437cd400 00100000:10000000:3.0:1787782055.717958:0:15825:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787782055.735174:0:15825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150631eb 00000020:00000080:0.0:1787782055.735193:0:15825:0:(genops.c:885:class_export_put()) final put ffff993c431b7800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787782055.735221:0:15825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d7c44e000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787782055.735226:0:15825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7c44e000 2 00000020:01000004:0.0:1787782055.735230:0:15825:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff993d7c44e000 from lustre-OST0001 00000020:00000080:0.0:1787782055.735270:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782055.735284:0:15825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787782055.735288:0:15825:0:(genops.c:885:class_export_put()) final put ffff993d67ccb000/lustre-OST0001_UUID 00000020:00000080:0.0:1787782055.735291:0:15825:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67ccb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787782055.735300:0:15825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787782055.735950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c431b7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787782055.736548:0:15825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2f49034a-383c-4a58-b5dc-1e0e9271edf7->MGS 00010000:00010000:1.0:1787782055.736582:0:15825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166400/0xc6d6745c15062f44 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782055.736599:0:15825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166400/0xc6d6745c15062f44 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782055.736654:0:15825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787782055.736658:0:15825:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787782055.736662:0:15825:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787782055.736840:0:15825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782055.736845:0:15825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166400/0xc6d6745c15062f44 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c15062f4b expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782055.736880:0:15825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782055.736905:0:15825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782055.736911:0:15825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782055.736914:0:15825:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787782055.736916:0:15825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787782055.736928:0:15825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff993d4736b800 00010000:00010000:1.0:1787782055.736931:0:15825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c150633b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6d6745c150633c0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787782055.736954:0:15825:0:(import.c:65:import_set_state_nolock()) ffff993d4736b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787782055.736960:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787782055.736963:0:15825:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787782055.736965:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787782055.736970:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787782055.736985:0:15825:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff993c43fe2940 x1874624963063424/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787782060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787782055.737010:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787782055.737013:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1787782055.737090:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f49034a-383c-4a58-b5dc-1e0e9271edf7:3656:1874624963063424:0@lo:250:kworker.0 10000000:01000000:1.0:1787782055.737221:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787782055.737231:0:15825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15062e41 00000020:00000080:1.0:1787782055.737238:0:15825:0:(genops.c:885:class_export_put()) final put ffff993d5eac7800/2f49034a-383c-4a58-b5dc-1e0e9271edf7 00000020:01000000:1.0:1787782055.737258:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.116@tcp (flags='') 00000020:00000080:1.0:1787782055.737265:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782055.737274:0:15825:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787782055.737278:0:15825:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff993d588099b8) has no exports 00000020:00000080:2.0:1787782055.737990:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d5eac7800/2f49034a-383c-4a58-b5dc-1e0e9271edf7 for MGC192.168.206.116@tcp 10000000:01000000:0.0:1787782055.738245:0:6528:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787782055.738566:0:15825:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.116@tcp: client import never connected 00000100:00080000:1.0:1787782055.738580:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787782055.738585:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787782055.738588:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787782055.738646:0:15825:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787782055.738717:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782055.738728:0:15825:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.116@tcp (uuid 2f49034a-383c-4a58-b5dc-1e0e9271edf7) 00000020:01000000:1.0:1787782055.738736:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787782055.738740:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782055.738745:0:15825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787782055.738752:0:15825:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff993c426ac800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787782055.738759:0:15825:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff993c43064d28) has exports, disconnecting them 00000020:00080000:1.0:1787782055.738763:0:15825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff993c426ac800), last request at 1787781822 00000020:00000080:1.0:1787782055.738769:0:15825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c15063215 00000020:00080000:1.0:1787782055.738782:0:15825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c426ac800): rc 0 00000020:00000080:1.0:1787782055.738787:0:15825:0:(genops.c:885:class_export_put()) final put ffff993c426ac800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787782055.743648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993d4736b800 for MGC192.168.206.116@tcp 00000020:00000080:0.0:1787782055.743670:0:36:0:(genops.c:885:class_export_put()) final put ffff993d4736e000/2f49034a-383c-4a58-b5dc-1e0e9271edf7 00000020:00000080:0.0:1787782055.743686:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d4736e000/2f49034a-383c-4a58-b5dc-1e0e9271edf7 for MGC192.168.206.116@tcp 00000020:01000000:0.0:1787782055.743696:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.116@tcp (2f49034a-383c-4a58-b5dc-1e0e9271edf7) 00000020:00000080:0.0:1787782055.744030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426ac800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787782055.744082:0:15825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787782055.744087:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782055.744093:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787782055.744101:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782055.744280:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782055.744290:0:15825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787782055.744298:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787782055.744303:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782055.744308:0:15825:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787782055.744316:0:15825:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff993c4346d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782055.744322:0:15825:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff993c43060000) has exports, disconnecting them 00000020:00080000:0.0:1787782055.744328:0:15825:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff993c4346d800), last request at 1787781822 00000020:00000080:0.0:1787782055.744332:0:15825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c1506322a 00000020:00080000:0.0:1787782055.744369:0:15825:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff993c4346d800): rc 0 00000020:00000080:0.0:1787782055.744376:0:15825:0:(genops.c:885:class_export_put()) final put ffff993c4346d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787782055.744688:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c4346c800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787782055.744696:0:36:0:(genops.c:885:class_export_put()) final put ffff993d67b7c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787782055.744710:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67b7c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787782055.744715:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787782055.744771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c4346d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787782055.760037:0:15825:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787782055.760061:0:15825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787782055.760066:0:15825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782055.760076:0:15825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787782055.760113:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff993c4346c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787782055.762723:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787782055.769772:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787782055.774269:0:10349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787782055.798020:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787782055.799161:0:6514:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff993d59080e00:6514] 0 exiting: rc = 1 00000100:00100000:2.0:1787782055.799812:0:6515:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff993d59081e00:6515] 1 exiting: rc = 0 00000100:00100000:1.0:1787782055.799947:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782055.800348:0:6517:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff993d4c3db000:6517] 1 exiting: rc = 0 00000100:00100000:2.0:1787782055.800426:0:6518:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff993d72977a00:6518] 2 exiting: rc = 0 00000100:00100000:2.0:1787782055.802779:0:6516:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff993d72977e00:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1787782055.803765:0:9533:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff993c43213800:9533] 3 exiting: rc = 0 00000100:00100000:1.0:1787782055.803960:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.803972:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.803979:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.803986:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.803993:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.803999:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804005:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804011:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804016:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804023:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804028:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804035:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804040:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804057:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804063:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804070:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804076:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804083:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804104:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804110:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804117:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804123:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804128:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804134:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804140:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804145:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804151:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804157:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804162:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804168:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804172:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804178:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804184:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804190:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804196:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804202:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804208:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804214:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804220:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804226:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804233:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804239:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804245:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804251:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804257:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804263:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804269:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804276:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804282:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804287:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804293:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804299:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804315:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804328:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804344:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804350:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804357:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804370:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804377:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804383:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804396:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804402:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804408:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.804415:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787782055.808856:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782055.808876:0:15825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787782055.808883:0:15825:0:(genops.c:885:class_export_put()) final put ffff993c43468800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787782055.808889:0:15825:0:(genops.c:844:class_export_destroy()) destroying export ffff993c43468800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787782055.808896:0:15825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787782055.808968:0:15825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d7c44e000 1 00000020:00000080:1.0:1787782055.808976:0:15825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6d6745c150631ba 00000020:00000080:1.0:1787782055.808984:0:15825:0:(genops.c:885:class_export_put()) final put ffff993c426af800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787782055.809004:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787782055.809009:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782055.809014:0:15825:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787782055.809019:0:15825:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff993c43063370) has no exports 00000020:00000080:2.0:1787782055.812338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff993c426af800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787782055.857171:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782055.857191:0:15825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787782055.857199:0:15825:0:(genops.c:885:class_export_put()) final put ffff993d7c449800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787782055.857205:0:15825:0:(genops.c:844:class_export_destroy()) destroying export ffff993d7c449800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787782055.857220:0:15825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787782055.857694:0:15825:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff993d7c44d800 00000020:01000000:3.0:1787782055.857729:0:15825:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787782055.857735:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782055.857741:0:15825:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787782055.857745:0:15825:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff993d5ea94d28) has no exports 00000020:00000080:3.0:1787782055.857789:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782055.857796:0:15825:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787782055.857799:0:15825:0:(genops.c:885:class_export_put()) final put ffff993d67fbe800/OSS_uuid 00000020:00000080:3.0:1787782055.857802:0:15825:0:(genops.c:844:class_export_destroy()) destroying export ffff993d67fbe800/OSS_uuid for OSS 00000020:01000000:3.0:1787782055.857806:0:15825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787782055.857836:0:6527:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787782055.858659:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff993d50d96a00:8447] 2 exiting: rc = 0 00000100:00100000:0.0:1787782055.858732:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff993d772b3800:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1787782055.858784:0:13830:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff993d53b57200:13830] 4 exiting: rc = 0 00000100:00100000:1.0:1787782055.859848:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff993d78c8c400:8445] 0 exiting: rc = 1 00000100:00100000:1.0:1787782055.859935:0:8638:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff993d679f1600:8638] 3 exiting: rc = 0 00000100:00100000:3.0:1787782055.860080:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860088:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860109:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860223:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860235:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860241:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860246:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860251:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860256:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860262:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860266:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860271:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860275:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860280:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860285:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860290:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860295:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860300:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860315:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860321:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860326:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860337:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860343:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860348:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860353:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860358:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860368:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860374:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860379:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860385:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860390:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860395:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860399:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860405:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860410:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860415:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860419:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860432:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860437:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860442:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860447:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860452:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860457:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860462:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860467:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860742:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860748:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860753:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860758:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860764:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860770:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860774:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860779:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860785:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860790:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860795:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860800:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860805:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860810:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860815:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860820:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860826:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860831:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.860837:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.863913:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff993d50d96200:8448] 0 exiting: rc = 1 00000100:00100000:1.0:1787782055.864030:0:10768:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff993c426d2000:10768] 2 exiting: rc = 0 00000100:00100000:1.0:1787782055.864717:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff993d50d97c00:8449] 1 exiting: rc = 0 00000100:00100000:3.0:1787782055.864825:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864833:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864841:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864847:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864853:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864859:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864865:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864870:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864895:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864900:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864906:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864912:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864918:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864923:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864928:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864933:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864939:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864944:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864949:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864954:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864959:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864964:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864969:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864976:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864983:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864988:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.864993:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865000:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865006:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865021:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865031:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865037:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865055:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865061:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865066:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865072:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865077:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865082:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865087:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865091:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865097:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865102:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865107:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865240:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865249:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865254:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865259:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865265:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865270:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865275:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865279:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865285:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865289:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865294:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865299:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865315:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865321:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865327:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865332:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865337:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865350:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865356:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865361:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.865467:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782055.868547:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff993d50d96600:8451] 1 exiting: rc = 0 00000100:00100000:1.0:1787782055.868819:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff993d50d97e00:8450] 0 exiting: rc = 1 00000100:00100000:0.0:1787782055.869408:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff993d67d28c00:8452] 2 exiting: rc = 0 00000100:00100000:3.0:1787782055.869626:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869636:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869642:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869648:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869653:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869659:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869665:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869671:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869677:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869683:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869688:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869693:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869698:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869703:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869717:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869723:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869739:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869746:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869751:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869757:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869763:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869769:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869775:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869780:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869785:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869791:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869796:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869802:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869807:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869813:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869819:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869824:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869830:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869836:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869841:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869846:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869852:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869857:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869862:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869868:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869883:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869889:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869896:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869901:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869907:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869913:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869918:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869924:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869930:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869941:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869946:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869952:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869958:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869963:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869969:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869975:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869981:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869986:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869991:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.869997:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.870003:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.870009:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.870015:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.870021:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782055.887352:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff993d72bf2400:8454] 1 exiting: rc = 0 00000100:00100000:1.0:1787782055.887951:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff993d72bf2a00:8453] 0 exiting: rc = 1 00000100:00100000:3.0:1787782055.888079:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888088:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888094:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888100:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888106:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888113:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888129:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888136:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888175:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888184:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888189:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888195:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888201:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888206:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888212:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888218:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888224:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888230:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888236:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888241:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888263:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888269:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888274:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888280:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888286:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888291:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888297:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888303:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888309:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888315:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888321:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888326:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888331:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888337:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888342:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888347:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888353:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888358:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888373:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888379:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888385:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888390:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888396:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888401:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888406:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888412:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888417:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888423:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888428:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888433:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888438:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888443:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888448:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888453:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888458:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888479:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888486:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888492:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888497:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888503:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888508:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888514:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888519:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.888531:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782055.889535:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff993d7723cc00:8456] 1 exiting: rc = 0 00000100:00100000:1.0:1787782055.889942:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff993d7723d800:8455] 0 exiting: rc = 1 00000100:00100000:3.0:1787782055.890235:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890245:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890251:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890258:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890265:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890273:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890281:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890288:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890295:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890303:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890311:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890319:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890345:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890352:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890371:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890383:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890391:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890399:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890408:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890416:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890423:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890430:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890437:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890443:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890464:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890583:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890598:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890743:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890753:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890759:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890764:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890772:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890779:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890788:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890798:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890805:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890830:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890838:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890845:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890851:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890858:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890863:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890870:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890878:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890885:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890891:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890898:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890904:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890927:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890934:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890941:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890947:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890953:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890960:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890965:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890971:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890978:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890984:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890990:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.890996:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.891018:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.891031:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.891038:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782055.891114:0:15825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787782055.913969:0:15825:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787782078.208471:0:16589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787782089.820406:0:17188:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787782089.820412:0:17188:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787782089.820413:0:17188:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787782089.820521:0:17188:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993c4442b000 00000020:01000004:3.0:1787782089.820537:0:17188:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787782089.820556:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787782089.820570:0:17188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff993d770db370) 00000020:00000080:3.0:1787782089.820584:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787782089.976038:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787782089.989303:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787782089.993227:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787782089.994517:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787782089.995196:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787782089.995882:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787782090.005433:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787782090.005909:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.009064:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787782090.010047:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787782090.011314:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787782090.012388:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787782090.012875:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787782090.013484:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.014902:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.015641:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.016178:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.016888:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.017427:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.018204:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.019903:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.021505:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.024199:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.026929:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.028073:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.032702:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.033156:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.033639:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.034865:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.036399:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.039442:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.040140:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.040773:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.041654:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.042262:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.042532:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.042756:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.043788:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.047793:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.048253:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.048506:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.048744:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.048996:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.049286:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.049522:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787782090.055854:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787782090.063392:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.069923:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.072558:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.078600:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.079356:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.079630:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787782090.079917:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787782090.080751:0:17188:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787782090.080977:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787782090.080985:0:17188:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787782090.080996:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c150643fe 00000020:01000004:3.0:1787782090.081002:0:17188:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787782090.081007:0:17188:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787782090.081011:0:17188:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993c4442b000 from MGS 00000020:01000004:3.0:1787782090.081014:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787782090.081024:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff993d770d8000) 00000020:00000080:3.0:1787782090.081034:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787782090.081095:0:17188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c4442b000 from MGS, refs=2 00080000:01000000:3.0:1787782090.081100:0:17188:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787782090.081105:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c1506440c 00000100:00100000:3.0:1787782090.081199:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787782090.081321:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787782090.081327:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787782090.088560:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787782090.088574:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787782090.095350:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782090.095535:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787782090.095547:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787782090.096433:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787782090.096442:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787782090.096781:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787782090.096788:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787782090.097554:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.097558:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.097560:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.110130:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.110137:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.110140:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782090.118995:0:17188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787782090.124231:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787782090.127783:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787782090.129457:0:17200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787782090.135685:0:17188:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787782090.135773:0:17188:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787782090.136706:0:17188:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787782090.137016:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782090.137181:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787782090.137188:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787782090.142349:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787782090.142362:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787782090.142760:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787782090.142766:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787782090.143469:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787782090.143489:0:17188:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.116@tcp' 00000020:01000004:1.0:1787782090.143491:0:17188:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787782090.143519:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.116@tcp (typ=mgc) 00000020:00000080:1.0:1787782090.143531:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.116@tcp (ffff993c437e0000) 00000020:00000080:1.0:1787782090.143546:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787782090.143659:0:17188:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c437f0800@MGC192.168.206.116@tcp: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787782090.143803:0:17188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.116@tcp-0 is initialized 00000040:01000000:1.0:1787782090.143809:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787782090.144039:0:17206:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787782090.144064:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.116@tcp (uuid 919c9bfc-060e-4da8-a874-7b13cf1bdaec) 00000020:00000080:1.0:1787782090.144078:0:17188:0:(genops.c:1385:class_connect()) connect: client 919c9bfc-060e-4da8-a874-7b13cf1bdaec, cookie 0xc6d6745c1506441a 00000100:00080000:1.0:1787782090.144088:0:17188:0:(import.c:510:import_select_connection()) MGC192.168.206.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782090.144093:0:17188:0:(import.c:624:import_select_connection()) MGC192.168.206.116@tcp: import ffff993c437f0800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782090.144124:0:17188:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e43840 x1874624963063936/t0(0) o250->MGC192.168.206.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782090.144159:0:17188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 919c9bfc-060e-4da8-a874-7b13cf1bdaec->MGS 00000020:01000004:1.0:1787782090.144187:0:17188:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787782090.144192:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787782090.144202:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff993c437e3370) 00000020:00000080:1.0:1787782090.144211:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1787782090.146390:0:17205:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1787782090.147716:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3656:1874624963063936:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787782090.147787:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.174764:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963063936 00000100:00100000:0.0:1787782090.174776:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963063936 00000100:00100000:0.0:1787782090.174826:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782090.174834:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3656:x1874624963063936:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787782090.174858:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 919c9bfc-060e-4da8-a874-7b13cf1bdaec@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1787782090.174881:0:17201:0:(genops.c:1385:class_connect()) connect: client 919c9bfc-060e-4da8-a874-7b13cf1bdaec, cookie 0xc6d6745c15064428 00000100:00080000:0.0:1787782090.174992:0:17201:0:(import.c:65:import_set_state_nolock()) ffff993d770fb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782090.175074:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:3656:x1874624963063936:12345-0@lo:250:mount.lustre.0 Request processed in 240us (27286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.175080:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782090.175480:0:3656:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787782090.175489:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1787782090.175496:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787782090.175500:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787782090.175503:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c437f0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787782090.175506:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787782090.175523:0:3656:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787782090.175528:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3656:1874624963063936:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787782090.177050:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782090.177281:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782090.177290:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787782090.193274:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782090.193287:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787782090.194260:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782090.194269:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787782090.194923:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782090.195103:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787782090.195108:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787782090.195693:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787782090.195701:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787782090.280060:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782090.280871:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787782090.280878:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787782090.298020:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787782090.298034:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787782090.302094:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782090.302298:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787782090.302305:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787782090.303099:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787782090.303108:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787782090.303704:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782090.303855:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787782090.303860:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787782090.309229:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787782090.309246:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787782090.327328:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782090.327544:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787782090.327552:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787782090.330832:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787782090.330849:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787782090.365009:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782090.365233:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787782090.365241:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787782090.372909:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787782090.372925:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787782090.374659:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787782090.374669:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787782090.377102:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787782090.377135:0:17188:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787782090.377141:0:17188:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787782090.377254:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787782090.377296:0:17188:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.116@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787782090.377300:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787782090.377302:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782090.377303:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782090.377304:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782090.377310:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782090.377311:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782090.377312:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782090.377313:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782090.377315:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782090.377316:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782090.377318:0:17188:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787782090.377320:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782090.377321:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782090.377322:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782090.377323:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782090.377324:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782090.377325:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782090.377326:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782090.377327:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782090.377328:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782090.377328:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782090.377571:0:17188:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787782090.377590:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782090.377846:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782090.377898:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80acd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782090.378365:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064064 00000100:00100000:2.0:1787782090.378372:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064064 00000100:00100000:2.0:1787782090.378424:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782090.378432:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:17188:x1874624963064064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782090.378740:0:17204:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787782090.378744:0:17204:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787782090.378747:0:17204:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787782090.379088:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787782090.384075:0:17204:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1787782090.401200:0:17226:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787782090.401210:0:17226:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787782090.401213:0:17226:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787782090.401215:0:17226:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787782090.401674:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787782090.402822:0:17204:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787782090.402834:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787782090.406389:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:17188:x1874624963064064:12345-0@lo:253:mount.lustre.0 Request processed in 27943us (28529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.406405:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782090.406550:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064064:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787782090.406564:0:17188:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787782090.406567:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782090.406569:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787782090.406570:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782090.406572:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782090.406573:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782090.406574:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782090.406575:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787782090.406577:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787782090.406578:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782090.406579:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787782090.406597:0:17188:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993c4442b000 from lustre-MDT0000 10000000:01000000:1.0:1787782090.406659:0:17188:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787782090.406661:0:17188:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787782090.406665:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff993c437e0000 10000000:01000000:1.0:1787782090.406669:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787782090.406677:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff993c437e0000 from 1 10000000:01000000:1.0:1787782090.406679:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787782090.406713:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.406723:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.406746:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782090.406764:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782090.406806:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.406829:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.407037:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064192 00000100:00100000:0.0:1787782090.407042:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064192 00000100:00100000:0.0:1787782090.407075:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782090.407082:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:17188:x1874624963064192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.407099:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782090.407111:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166000/0xc6d6745c15064436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506442f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.407130:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166000/0xc6d6745c15064436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506442f expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.407140:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166000/0xc6d6745c15064436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506442f expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.407149:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166000, rc 0) 00000100:00100000:0.0:1787782090.407182:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+6:17188:x1874624963064192:12345-0@lo:101:mount.lustre.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.407189:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782090.407641:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782090.407655:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.407664:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782090.407732:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782090.407759:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.407781:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.407850:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064320 00000100:00100000:3.0:1787782090.407856:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064320 00000100:00100000:3.0:1787782090.407881:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782090.407887:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+6:17188:x1874624963064320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782090.407973:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+6:17188:x1874624963064320:12345-0@lo:501:mount.lustre.0 Request processed in 86us (212us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782090.407980:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782090.408132:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787782090.408161:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787782090.408177:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.408186:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782090.408194:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993c4442b000 10000000:01000000:1.0:1787782090.408199:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787782090.408209:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff993c4442b000 10000000:01000000:1.0:1787782090.408221:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787782090.408225:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff993c4442b000 from 1 10000000:01000000:1.0:1787782090.408227:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787782090.408244:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.408251:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.408259:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782090.408271:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782090.408297:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.408316:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.408800:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064448 00000100:00100000:3.0:1787782090.408813:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064448 00000100:00100000:3.0:1787782090.408844:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782090.408854:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+6:17188:x1874624963064448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782090.408867:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782090.408880:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704800/0xc6d6745c15064444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506443d expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.408896:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704800/0xc6d6745c15064444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506443d expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.408905:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704800/0xc6d6745c15064444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506443d expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.408912:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704800, rc 0) 00000100:00100000:3.0:1787782090.409454:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+7:17188:x1874624963064448:12345-0@lo:101:mount.lustre.0 Request processed in 597us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.409462:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782090.409672:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782090.409685:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064444 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.409695:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064444 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782090.409708:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787782090.409720:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064444 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.409727:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa400/0xc6d6745c1506443d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064444 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782090.409746:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787782090.409750:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787782090.409754:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff993c4442b000 10000000:01000000:1.0:1787782090.409757:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787782090.409760:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787782090.409762:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787782090.409780:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.409787:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.409795:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782090.409809:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782090.409836:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.409855:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.409941:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064576 00000100:00100000:0.0:1787782090.409946:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064576 00000100:00100000:0.0:1787782090.409981:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782090.409988:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+7:17188:x1874624963064576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.409996:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782090.410008:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166800/0xc6d6745c15064452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506444b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.410023:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166800/0xc6d6745c15064452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506444b expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.410031:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166800/0xc6d6745c15064452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506444b expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.410038:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166800, rc 0) 00000100:00100000:0.0:1787782090.410076:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+8:17188:x1874624963064576:12345-0@lo:101:mount.lustre.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.410082:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782090.410520:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782090.410533:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064452 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782090.410541:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064452 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782090.410593:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782090.410639:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.410717:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.425022:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064704 00000100:00100000:0.0:1787782090.425036:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064704 00000100:00100000:0.0:1787782090.425274:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782090.425285:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+8:17188:x1874624963064704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.425524:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17188:x1874624963064704:12345-0@lo:501:mount.lustre.0 Request processed in 241us (14883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.425532:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782090.427768:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e430c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782090.427832:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782090.427904:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.427955:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d5884fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.429041:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064832 00000100:00100000:3.0:1787782090.429051:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064832 00000100:00100000:3.0:1787782090.429114:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782090.429123:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17188:x1874624963064832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782090.432034:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17188:x1874624963064832:12345-0@lo:503:mount.lustre.0 Request processed in 2904us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.432045:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782090.438540:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963064832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782090.444713:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17227:1874624963064960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782090.444803:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.444850:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d5884f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.445289:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963064960 00000100:00100000:3.0:1787782090.445295:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963064960 00000100:00100000:3.0:1787782090.445342:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782090.445359:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17227:x1874624963064960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.447190:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17227:x1874624963064960:12345-0@lo:502:llog_process_th.0 Request processed in 1833us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.447201:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782090.447472:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17227:1874624963064960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782090.447509:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782090.447526:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.447528:0:17227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787782090.447533:0:17227:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787782090.447536:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787782090.447553:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff993c43064d28) 00000020:00000080:2.0:1787782090.447568:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787782090.447572:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787782090.447792:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787782090.447800:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15064460 00000020:00000080:3.0:1787782090.448011:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787782090.448016:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782090.448019:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.448021:0:17227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782090.448024:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782090.448028:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.448029:0:17227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787782090.448033:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782090.448040:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff993d770d99b8) 00000020:00000080:3.0:1787782090.448050:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787782090.448054:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787782090.448056:0:17227:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787782090.448059:0:17227:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787782090.448064:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782090.448111:0:17227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c4442b000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787782090.448124:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff993d770dcd28) 00000020:00000080:3.0:1787782090.448132:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787782090.448181:0:17227:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787782090.448187:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15064475 00000020:00000080:3.0:1787782090.448287:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787782090.448293:0:17227:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787782090.448297:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6d6745c1506447c 00080000:01000000:3.0:1787782090.448301:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787782090.448304:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15064483 00010000:00010000:2.0:1787782090.611914:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787782090.612587:0:17227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787782090.616474:0:17227:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787782090.617862:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff993c430619b8) 00000020:00000080:2.0:1787782090.617883:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787782090.618110:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787782090.618119:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c15064491 00000020:00000080:1.0:1787782090.626179:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787782090.630957:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6d6745c15064498 00000020:00000080:2.0:1787782090.634490:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787782090.634504:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.634511:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.634513:0:17227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787782090.634517:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787782090.634520:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787782090.634522:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.634523:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.634524:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787782090.634527:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.634528:0:17227:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787782090.634531:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782090.634535:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.634537:0:17227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787782090.634541:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787782090.634588:0:17227:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787782090.634604:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.634626:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.634628:0:17227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787782090.634643:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782090.634647:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.634648:0:17227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787782090.634661:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787782090.634667:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:00000080:2.0:1787782090.634693:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787782090.634712:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff993c43063370) 00000020:00000080:2.0:1787782090.634729:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787782090.634734:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787782090.634791:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787782090.634796:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787782090.634802:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c150644a6 00010000:00080000:2.0:1787782090.634833:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d49f00800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787782090.639092:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787782090.644064:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782090.644078:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787782090.644117:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787782090.644136:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c150644ad 00000100:00080000:2.0:1787782090.644148:0:17227:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782090.644155:0:17227:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff993d49f00800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782090.644198:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd8f00 x1874624963065088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782090.644393:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787782090.644460:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.644464:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.644466:0:17227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787782090.644469:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787782090.644471:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787782090.644473:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.644474:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.644475:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787782090.644485:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.644487:0:17227:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787782090.644490:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787782090.644494:0:17227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787782090.644496:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.644497:0:17227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787782090.644500:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787782090.644504:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:2.0:1787782090.644526:0:17227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787782090.644528:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787782090.644542:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff993c43060000) 00000020:00000080:2.0:1787782090.644553:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787782090.644558:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787782090.644641:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787782090.644647:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000100:00100000:0.0:1787782090.644818:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782090.644895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782090.645028:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065088 00000100:00100000:1.0:1787782090.645035:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065088 00000100:00100000:1.0:1787782090.645068:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782090.645076:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963065088:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787782090.645093:0:17214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1787782090.646482:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c150644bb 00010000:00080000:2.0:1787782090.646584:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d67b7f800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787782090.652069:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787782090.660759:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787782090.662745:0:17227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787782090.673282:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782090.674168:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787782090.696255:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1787782090.698061:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963065088:12345-0@lo:38:llog_process_th.0 Request processed in 52979us (53160us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787782090.698078:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787782090.698193:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782090.698201:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782090.698205:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065088:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787782090.704308:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787782090.704317:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787782090.705877:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782090.705891:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787782090.706001:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787782090.706021:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c150644c2 00000100:00080000:2.0:1787782090.706031:0:17227:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782090.706037:0:17227:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff993d67b7f800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782090.706070:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd8f00 x1874624963065216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782090.706138:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065216:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787782090.706205:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963065216 offset 0 length 520: 4 00000100:00080000:2.0:1787782090.706272:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787782090.706330:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.706334:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.706336:0:17227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787782090.706339:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787782090.706342:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787782090.706344:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.706345:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787782090.706346:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787782090.706348:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.706349:0:17227:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787782090.706352:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787782090.706356:0:17227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787782090.706359:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.706360:0:17227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787782090.706362:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787782090.706366:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:2.0:1787782090.706396:0:17227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787782090.706399:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787782090.706417:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff993d7ade99b8) 00000020:00000080:2.0:1787782090.706430:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787782090.706435:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787782090.706501:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787782090.706507:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787782090.706513:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6d6745c150644d0 00010000:00080000:2.0:1787782090.706549:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d67b78800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787782090.706816:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787782090.706895:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787782090.706912:0:17227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787782090.709485:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782090.710010:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787782090.710205:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787782090.716039:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787782090.716049:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787782090.717157:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782090.717170:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787782090.717210:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787782090.717231:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c150644d7 00000100:00080000:0.0:1787782090.717242:0:17227:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787782090.717248:0:17227:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff993d67b78800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782090.717282:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a5a40 x1874624963065344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782090.717311:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787782090.717370:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782090.717384:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782090.717386:0:17227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787782090.717390:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782090.717394:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782090.717396:0:17227:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787782090.717399:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787782090.717401:0:17227:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787782090.717403:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782090.717405:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782090.717406:0:17227:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787782090.717408:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782090.717410:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782090.717412:0:17227:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787782090.717415:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787782090.717445:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17227:1874624963065472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782090.717517:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.717549:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782090.717641:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065344:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787782090.717679:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963065344 offset 0 length 520: 4 00000100:00100000:3.0:1787782090.718187:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065472 00000100:00100000:3.0:1787782090.718197:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065472 00000100:00100000:3.0:1787782090.718243:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782090.718251:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17227:x1874624963065472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.718388:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17227:x1874624963065472:12345-0@lo:502:llog_process_th.0 Request processed in 137us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.718396:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782090.718512:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17227:1874624963065472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782090.718540:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.718546:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.718549:0:17227:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787782090.718553:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787782090.718955:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787782090.718980:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787782090.719001:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064452 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.719013:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfbc00/0xc6d6745c1506444b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064452 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782090.719022:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993c4442b000 from 1 10000000:01000000:3.0:1787782090.719025:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787782090.719055:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.719064:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.719073:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782090.719092:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782090.719140:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782090.719176:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58f41900 going to sleep for 11 seconds 00000100:00100000:2.0:1787782090.719332:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065600 00000100:00100000:2.0:1787782090.719338:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065600 00000100:00100000:2.0:1787782090.719373:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782090.719391:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+9:17188:x1874624963065600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782090.719402:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782090.719416:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150644de expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.719435:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150644de expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.719446:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150644de expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.719455:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5400, rc 0) 00000100:00100000:2.0:1787782090.719500:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+10:17188:x1874624963065600:12345-0@lo:101:mount.lustre.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782090.719507:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782090.719578:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.719592:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.719601:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782090.720176:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065728:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787782090.720214:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.720232:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.720252:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065728 00000100:00100000:0.0:1787782090.720256:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065728 00000100:00100000:0.0:1787782090.720295:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782090.720301:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+10:17188:x1874624963065728:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787782090.720315:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787782090.720320:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787782090.720394:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+10:17188:x1874624963065728:12345-0@lo:256:mount.lustre.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.720401:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782090.720435:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065728:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787782090.720990:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782090.721004:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721014:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782090.721022:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993c4442b000 from 1 10000000:01000000:0.0:1787782090.721024:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782090.721048:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721056:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721064:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782090.721078:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782090.721109:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.721134:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.721157:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065856 00000100:00100000:0.0:1787782090.721161:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065856 00000100:00100000:0.0:1787782090.721181:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782090.721187:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+10:17188:x1874624963065856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.721196:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782090.721207:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150644ec expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721224:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150644ec expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721233:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150644ec expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721241:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166400, rc 0) 00000100:00100000:0.0:1787782090.721293:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963065856:12345-0@lo:101:mount.lustre.0 Request processed in 105us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.721298:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782090.721330:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.721342:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.721350:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782090.721409:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.721433:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.721452:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.721465:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963065984 00000100:00100000:0.0:1787782090.721468:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963065984 00000100:00100000:0.0:1787782090.721484:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782090.721490:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963065984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.721627:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963065984:12345-0@lo:501:mount.lustre.0 Request processed in 116us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.721634:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782090.721663:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963065984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.721704:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782090.721741:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.721753:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.721765:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066112 00000100:00100000:0.0:1787782090.721768:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066112 00000100:00100000:0.0:1787782090.721785:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782090.721790:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963066112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782090.721863:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963066112:12345-0@lo:503:mount.lustre.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.721870:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782090.721906:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782090.728207:0:17237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17237:1874624963066240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782090.728351:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.728444:0:17237:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.728481:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066240 00000100:00100000:0.0:1787782090.728487:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066240 00000100:00100000:0.0:1787782090.728565:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782090.728574:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17237:x1874624963066240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782090.729128:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17237:x1874624963066240:12345-0@lo:502:llog_process_th.0 Request processed in 554us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.729143:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782090.729245:0:17237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17237:1874624963066240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782090.729275:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782090.729284:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.729286:0:17237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787782090.729296:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993c4442b000 00000020:00000080:3.0:1787782090.729299:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782090.729306:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782090.729309:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.729310:0:17237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787782090.729313:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782090.729315:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.729316:0:17237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787782090.729320:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993c4442b000 00000020:00000080:3.0:1787782090.729322:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782090.729368:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782090.730940:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.730946:0:17237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787782090.730958:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782090.730963:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782090.730964:0:17237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787782090.730969:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993c4442b000 00000020:00000080:3.0:1787782090.730972:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782090.731018:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782090.741058:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.741066:0:17237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782090.741079:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782090.741086:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782090.741087:0:17237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787782090.741093:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993c4442b000 00000020:00000080:2.0:1787782090.741096:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787782090.741191:0:17237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17237:1874624963066368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782090.741276:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.741321:0:17237:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.742397:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066368 00000100:00100000:3.0:1787782090.742407:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066368 00000100:00100000:3.0:1787782090.742487:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787782090.742498:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17237:x1874624963066368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.743013:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17237:x1874624963066368:12345-0@lo:502:llog_process_th.0 Request processed in 515us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.743029:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782090.746392:0:17237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17237:1874624963066368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787782090.746435:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782090.746445:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782090.746448:0:17237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787782090.746453:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787782090.746531:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787782090.746552:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787782090.746567:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.746578:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782090.746647:0:17188:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787782090.748824:0:17188:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993c4442b000 10000000:01000000:0.0:1787782090.748832:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993c4442b000 10000000:01000000:0.0:1787782090.748840:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782090.748847:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993c4442b000 from 1 10000000:01000000:0.0:1787782090.748851:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782090.748888:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.748899:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.748909:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782090.751083:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782090.751149:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.751193:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.752061:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066496 00000100:00100000:3.0:1787782090.752077:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066496 00000100:00100000:3.0:1787782090.752124:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782090.752133:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17188:x1874624963066496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782090.752148:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782090.752167:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43704e00/0xc6d6745c15064501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150644fa expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.752191:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43704e00/0xc6d6745c15064501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150644fa expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.752201:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43704e00/0xc6d6745c15064501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150644fa expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.752210:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704e00, rc 0) 00000100:00100000:3.0:1787782090.752268:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963066496:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.752275:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782090.753331:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782090.753355:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064501 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.753365:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064501 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782090.753450:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.753493:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.753526:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.753545:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066624 00000100:00100000:0.0:1787782090.753550:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066624 00000100:00100000:0.0:1787782090.753584:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782090.753592:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963066624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.753739:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963066624:12345-0@lo:501:mount.lustre.0 Request processed in 147us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.753746:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782090.753772:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782090.753799:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782090.753837:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.753849:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.753872:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066752 00000100:00100000:0.0:1787782090.753876:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066752 00000100:00100000:0.0:1787782090.753892:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782090.753898:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963066752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782090.755783:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963066752:12345-0@lo:503:mount.lustre.0 Request processed in 1876us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.755795:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782090.755851:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963066752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782090.756452:0:17241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963066880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.756496:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782090.756532:0:17241:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d450336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782090.756572:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963066880 00000100:00100000:0.0:1787782090.756578:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963066880 00000100:00100000:0.0:1787782090.756636:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782090.756645:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963066880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782090.756843:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963066880:12345-0@lo:502:llog_process_th.0 Request processed in 199us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782090.756850:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782090.756914:0:17241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963066880:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787782090.756975:0:17241:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787782090.756995:0:17241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff993d7aeccd28) 00000020:00000080:3.0:1787782090.757013:0:17241:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787782090.757090:0:17241:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c4442b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787782090.757098:0:17241:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993c4442b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787782090.757101:0:17241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993c4442b000 4 00010000:00080000:3.0:1787782090.757127:0:17241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d5eb6b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787782090.758750:0:17241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787782090.763735:0:17241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787782090.763849:0:17241:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787782090.763861:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6d6745c1506450f 00000100:00080000:3.0:1787782090.763982:0:17241:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787782090.763988:0:17241:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff993d5eb6b000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782090.764031:0:17241:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d49163c00 x1874624963067008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782090.764068:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963067008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782090.764136:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787782090.764293:0:17241:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787782090.765155:0:17241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963067136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.765204:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782090.765230:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067136 00000100:00100000:3.0:1787782090.765236:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067136 00000100:00100000:3.0:1787782090.765269:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782090.765278:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963067136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.765394:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963067136:12345-0@lo:502:llog_process_th.0 Request processed in 116us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.765402:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782090.765443:0:17241:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05180 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.765461:0:17241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963067136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.765498:0:17241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963067264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782090.765530:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782090.765549:0:17241:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782090.766413:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067008 00000100:00100000:2.0:1787782090.766421:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067008 00000100:00100000:2.0:1787782090.766448:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782090.766454:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963067008:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782090.766521:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963067008:12345-0@lo:38:llog_process_th.0 Request processed in 66us (2385us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787782090.766527:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782090.766590:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787782090.766597:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d5eb6b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782090.766601:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787782090.766656:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067264 00000100:00100000:2.0:1787782090.766660:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067264 00000100:00100000:2.0:1787782090.766684:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782090.766690:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963067264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782090.766882:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17241:x1874624963067264:12345-0@lo:502:llog_process_th.0 Request processed in 191us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782090.766889:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782090.767057:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963067008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782090.767221:0:17241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17241:1874624963067264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787782090.767250:0:17241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787782090.767437:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787782090.767460:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787782090.767473:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064501 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782090.767483:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82167200/0xc6d6745c150644fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064501 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787782090.767529:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787782090.767532:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782090.767533:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782090.767534:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782090.767535:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782090.767540:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782090.767542:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782090.767543:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782090.767544:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782090.767545:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782090.767548:0:17188:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787782090.767550:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787782090.767551:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782090.767552:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782090.767553:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782090.767554:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782090.767555:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782090.767556:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782090.767556:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782090.767557:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782090.767558:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782090.767574:0:17188:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787782090.767588:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963067392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787782090.767654:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782090.767684:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d47cb4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.767695:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067392 00000100:00100000:3.0:1787782090.767698:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067392 00000100:00100000:3.0:1787782090.767761:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782090.767777:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963067392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787782090.767797:0:17203:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787782090.767808:0:17203:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787782090.777446:0:17203:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787782090.777471:0:17203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787782090.777757:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17188:x1874624963067392:12345-0@lo:253:mount.lustre.0 Request processed in 9985us (10098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.777769:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1787782090.777951:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782090.777957:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782090.777975:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.777999:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150644de expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778007:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778041:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778055:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 11 pid: 17203 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782090.778068:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963067520:0@lo:104: 00000100:00100000:2.0:1787782090.778322:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.778364:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782090.778512:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067520 00000100:00100000:3.0:1787782090.778519:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067520 00000100:00100000:3.0:1787782090.778556:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782090.778564:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963067520:12345-0@lo:104: 00010000:00010000:3.0:1787782090.778576:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782090.778643:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782090.778654:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963067520:12345-0@lo:104: Request processed in 91us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782090.778661:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782090.778695:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963067520:0@lo:104: 00010000:00010000:3.0:1787782090.778713:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778936:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782090.778943:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778951:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782090.778955:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.778963:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782090.778971:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782090.778988:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787782090.780956:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.780970:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782090.780997:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781004:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c150644de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644e5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781024:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.781026:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782090.781027:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782090.781069:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782090.781151:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963067648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782090.781207:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782090.781264:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067648 00000100:00100000:2.0:1787782090.781270:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067648 00010000:00010000:2.0:1787782090.781294:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 12 pid: 17203 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782090.781318:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782090.781325:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:3659:x1874624963067648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782090.781331:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17188:1874624963067392:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1787782090.781335:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782090.781340:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 12 pid: 17203 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782090.781343:0:17188:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787782090.781345:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787782090.781347:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782090.781349:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:2.0:1787782090.781350:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 12 pid: 17203 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787782090.781350:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782090.781351:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782090.781352:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782090.781353:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782090.781355:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782090.781356:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782090.781357:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787782090.781370:0:17188:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787782090.781372:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e5400/0xc6d6745c150644e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150644de expref: 12 pid: 17203 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781399:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781406:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782090.781419:0:17194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003462655s 00010000:00010000:2.0:1787782090.781423:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781430:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781436:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781442:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781447:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782090.781451:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781459:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781472:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781487:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782090.781516:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:3659:x1874624963067648:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782090.781523:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787782090.781550:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781558:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782090.781564:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e5a00/0xc6d6745c15064516 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782090.781598:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963067648:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787782090.810464:0:17188:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787782090.811013:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787782090.819726:0:17250:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787782090.819736:0:17250:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787782090.820100:0:17251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787782090.820505:0:17251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787782090.820736:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787782090.825626:0:17251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787782090.825711:0:17251:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1787782090.826030:0:17252:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff993d67fd9e00 x1874624963067776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782090.826043:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00000040:01000000:3.0:1787782090.830228:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787782090.830272:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787782090.831093:0:17188:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787782090.831103:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787782090.831150:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782090.832848:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787782090.833915:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787782090.834353:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787782090.836350:0:17188:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787782090.842465:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787782090.849027:0:17188:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787782090.849075:0:17188:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffabe2818f7988 00100000:10000000:0.0:1787782090.849082:0:17188:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787782090.850058:0:17188:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787782090.850073:0:17188:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787782090.850094:0:17188:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787782090.850110:0:17188:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787782090.850980:0:17188:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787782090.851175:0:17188:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787782091.148053:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787782091.253757:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787782091.253764:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993c4442b000 from 7 10000000:01000000:1.0:1787782091.253769:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787782091.253816:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782091.253828:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782091.253838:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782091.253862:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963067904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782091.254004:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782091.254056:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782091.254135:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067904 00000100:00100000:3.0:1787782091.254142:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067904 00000100:00100000:3.0:1787782091.254227:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782091.254236:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+11:17206:x1874624963067904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782091.254249:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782091.254261:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506451d expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782091.254281:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506451d expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782091.254291:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506451d expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782091.254300:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705400, rc 0) 00000100:00100000:3.0:1787782091.254350:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17206:x1874624963067904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782091.254356:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782091.254426:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963067904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782091.254440:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782091.254449:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782091.254494:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963068032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787782091.254522:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782091.257635:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782091.258154:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068032 00000100:00100000:2.0:1787782091.258164:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068032 00000100:00100000:2.0:1787782091.258212:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782091.258233:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17206:x1874624963068032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787782091.258256:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787782091.258271:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787782091.258274:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787782091.258411:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17206:x1874624963068032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 179us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782091.258418:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782091.258570:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963068032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787782091.258645:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782091.258655:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782091.258665:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782091.782835:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787782091.852554:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782092.167492:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782092.810250:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782092.869678:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787782093.190833:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782093.897154:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782094.216992:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782094.930528:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00000001:02000400:0.0:1787782095.203911:0:17494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787782095.240430:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782095.888547:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963068160:0@lo:400:kworker.0 00000100:00100000:3.0:1787782095.888720:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782095.888840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782095.888845:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787782095.888849:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782095.888854:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:0.0:1787782095.888859:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787782095.888865:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff993d49f00800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782095.888894:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4f00 x1874624963068288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782095.888912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782095.888916:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782095.888919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782095.888923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782095.888925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782095.888928:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782095.888930:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d5eb6b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782095.888948:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff993d5eb6b000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782095.888963:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4000 x1874624963068416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782095.889037:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068288:0@lo:38:kworker.0 00000100:00100000:0.0:1787782095.889071:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782095.889098:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963068416:0@lo:38:kworker.0 00000100:00100000:0.0:1787782095.889125:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782095.889192:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068416 00000100:00100000:0.0:1787782095.889199:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068416 00000100:00100000:0.0:1787782095.889231:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782095.889238:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963068416:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787782095.889261:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:0.0:1787782095.889295:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6d6745c1506452b 00000004:00100000:0.0:1787782095.889308:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787782095.889465:0:17211:0:(import.c:65:import_set_state_nolock()) ffff993d4c834000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782095.889526:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874624963068416:12345-0@lo:38:kworker.0 Request processed in 287us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782095.889533:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782095.889572:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff993c431a4000 x1874624963068416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782095.889585:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787782095.889591:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787782095.889596:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782095.889598:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d5eb6b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782095.889603:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874624963068416:0@lo:38:kworker.0 00000100:00100000:1.0:1787782095.892616:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068160 00000100:00100000:1.0:1787782095.892628:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068160 00000100:00100000:1.0:1787782095.892685:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782095.892695:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:3657:x1874624963068160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782095.894700:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068288 00000100:00100000:2.0:1787782095.894713:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068288 00000100:00100000:2.0:1787782095.894751:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782095.894759:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963068288:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787782095.894778:0:17215:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787782095.897634:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:3657:x1874624963068160:12345-0@lo:400:kworker.0 Request processed in 4930us (8903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782095.897664:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787782095.903629:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963068160:0@lo:400:kworker.0 00000100:00100000:2.0:1787782095.914236:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963068288:12345-0@lo:38:kworker.0 Request processed in 19469us (25156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787782095.914250:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787782095.918887:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782095.918910:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787782095.918926:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068288:0@lo:38:kworker.0 00000100:00100000:2.0:1787782095.944457:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782096.263112:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787782096.426934:0:17546:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787782096.427491:0:17546:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787782096.972754:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782097.287518:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787782097.288799:0:17596:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787782097.289087:0:17596:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787782097.990545:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782098.310926:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782099.016511:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782099.333887:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782100.037750:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782100.358765:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782100.998496:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782100.998506:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787782100.998510:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782100.998521:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:0.0:1787782100.998529:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782100.998538:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff993d49f00800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782100.998571:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a61c0 x1874624963068672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782100.998587:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782100.998591:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782100.998594:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782100.998598:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782100.998626:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782090/real 1787782090] req@ffff993c431a5a40 x1874624963065344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782100.998662:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c431a5a40 x1874624963065344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782100.998673:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782090/real 1787782090] req@ffff993d67fd8f00 x1874624963065216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782100.998681:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963068544:0@lo:400:kworker.0 00000100:00100000:1.0:1787782100.998698:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993d67fd8f00 x1874624963065216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782100.998721:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068672:0@lo:38:kworker.0 00000100:00100000:3.0:1787782100.999564:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782100.999584:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963068800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782101.001633:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782101.001697:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782101.001716:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782101.001721:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065344:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787782101.001728:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782101.001733:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782101.001736:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963065216:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787782101.001830:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782101.001840:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787782101.001842:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782101.001848:0:14356:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1787782101.001853:0:14356:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787782101.001859:0:14356:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff993d67b7f800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782101.001904:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e43c00 x1874624963068928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782101.001921:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782101.001925:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782101.001927:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782101.001931:0:14356:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1787782101.001934:0:14356:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787782101.001940:0:14356:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff993d67b78800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782101.001953:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e40780 x1874624963069056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782101.001983:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068928:0@lo:8:kworker.0 00000400:00000100:1.0:1787782101.002018:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963068928 offset 0 length 520: 4 00000100:00100000:1.0:1787782101.002043:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963069056:0@lo:8:kworker.0 00000400:00000100:1.0:1787782101.002083:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963069056 offset 0 length 520: 4 00000100:00100000:3.0:1787782101.003496:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782101.003573:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068672 00000100:00100000:3.0:1787782101.003584:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068672 00000100:00100000:3.0:1787782101.003645:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782101.003656:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963068672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787782101.003681:0:17214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787782101.004688:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782101.005964:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068800 00000100:00100000:0.0:1787782101.005979:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068800 00000100:00100000:0.0:1787782101.006037:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782101.006047:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963068800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782101.006151:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963068800:12345-0@lo:400:kworker.0 Request processed in 105us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782101.006159:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782101.007181:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963068544 00000100:00100000:1.0:1787782101.007191:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963068544 00000100:00100000:1.0:1787782101.007260:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782101.007269:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:3658:x1874624963068544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782101.007857:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:3658:x1874624963068544:12345-0@lo:400:kworker.0 Request processed in 587us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782101.007972:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963068544:0@lo:400:kworker.0 00000100:00100000:1.0:1787782101.008025:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787782101.015866:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff993c431a6d00 x1874624963068800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782101.016132:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963068800:0@lo:400:kworker.0 00000100:00100000:3.0:1787782101.040200:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874624963068672:12345-0@lo:38:kworker.0 Request processed in 36537us (38564us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782101.040214:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787782101.042357:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782101.042370:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787782101.042375:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068672:0@lo:38:kworker.0 00000100:00100000:3.0:1787782101.063424:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782101.381806:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782102.022219:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782102.087403:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787782102.406066:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782103.119752:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787782103.435332:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782104.135101:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00000020:01000004:2.0:1787782104.362485:0:17941:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782104.362490:0:17941:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787782104.362492:0:17941:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787782104.362707:0:17941:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993d67ccb800 00000020:01000004:2.0:1787782104.362726:0:17941:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787782104.362740:0:17941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787782104.362757:0:17941:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff993d7adeb370) 00000020:00000080:2.0:1787782104.362777:0:17941:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1787782104.457971:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787782104.459493:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787782104.462596:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787782104.463954:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.464925:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.465221:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787782104.465438:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.465660:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787782104.466246:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.467967:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.468496:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.475111:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787782104.480418:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787782104.482727:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787782104.483660:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.484554:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.485240:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.485518:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.485916:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.486563:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.487269:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.490587:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.492042:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.492507:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.492968:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.493463:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.493952:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.495153:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.496548:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.497541:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.498493:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.498981:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.499468:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787782104.500142:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.500462:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787782104.504252:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787782104.504574:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.505332:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787782104.505579:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.505961:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787782104.507113:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.507994:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.508930:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.509355:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787782104.513465:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787782104.515427:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787782104.519154:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:3.0:1787782104.531742:0:17941:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787782104.532155:0:17941:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787782104.532167:0:17941:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787782104.532179:0:17941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15064539 00000020:01000004:3.0:1787782104.532185:0:17941:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787782104.532205:0:17941:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787782104.532209:0:17941:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787782104.532215:0:17941:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787782104.532240:0:17941:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787782104.532244:0:17941:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787782104.543089:0:17941:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787782104.543134:0:17941:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.116@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787782104.543138:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787782104.543140:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787782104.543142:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782104.543143:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782104.543144:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782104.543145:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782104.543147:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782104.543148:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782104.543150:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782104.543153:0:17941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787782104.543159:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782104.543160:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787782104.543161:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782104.543163:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782104.543164:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782104.543165:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782104.543235:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782104.543237:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782104.543238:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782104.543264:0:17941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787782104.543282:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782104.543352:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.543454:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.546239:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069184 00000100:00100000:1.0:1787782104.546255:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069184 00000100:00100000:1.0:1787782104.546322:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782104.546331:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17941:x1874624963069184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782104.546363:0:17201:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787782104.546367:0:17201:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787782104.546375:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787782104.547334:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17941:x1874624963069184:12345-0@lo:253:mount.lustre.0 Request processed in 999us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.547345:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782104.547461:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787782104.547477:0:17941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787782104.547481:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787782104.547482:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787782104.547484:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782104.547485:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782104.547486:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782104.547487:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782104.547489:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782104.547490:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782104.547492:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787782104.547511:0:17941:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993d67ccb800 from lustre-MDT0001 10000000:01000000:3.0:1787782104.547543:0:17941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787782104.547546:0:17941:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787782104.547553:0:17941:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993c437e0000 local copy 00010000:00010000:3.0:1787782104.547565:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.547713:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.547752:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.547804:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.548118:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069312 00000100:00100000:1.0:1787782104.548124:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069312 00000100:00100000:1.0:1787782104.548157:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782104.548165:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17941:x1874624963069312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782104.548261:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17941:x1874624963069312:12345-0@lo:501:mount.lustre.0 Request processed in 97us (508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782104.548269:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782104.554654:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069312:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787782104.554682:0:17941:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787782104.554739:0:17941:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787782104.554749:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.554760:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.554800:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d67ccb800 10000000:01000000:3.0:1787782104.554806:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787782104.554811:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff993c437e0000 10000000:01000000:3.0:1787782104.554814:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787782104.554817:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff993c437e0000 from 1 10000000:01000000:3.0:1787782104.554820:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787782104.554863:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.554871:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.554880:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.554899:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782104.554957:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.554990:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.555374:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069440 00000100:00100000:0.0:1787782104.555381:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069440 00000100:00100000:0.0:1787782104.555433:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782104.555443:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+12:17941:x1874624963069440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782104.555455:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782104.555470:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166600/0xc6d6745c15064547 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064540 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.555492:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166600/0xc6d6745c15064547 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064540 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.555504:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166600/0xc6d6745c15064547 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064540 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.555512:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166600, rc 0) 00000100:00100000:0.0:1787782104.555559:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+13:17941:x1874624963069440:12345-0@lo:101:mount.lustre.0 Request processed in 118us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.555567:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787782104.555731:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782104.555747:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064547 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.555771:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064547 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.555800:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787782104.556083:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064547 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.556091:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704200/0xc6d6745c15064540 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064547 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.556100:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff993d67ccb800 10000000:01000000:3.0:1787782104.556106:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787782104.556110:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff993d67ccb800 from 1 10000000:01000000:3.0:1787782104.556112:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787782104.556132:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.556139:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.556146:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.556161:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782104.556207:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.556237:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.556432:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069568 00000100:00100000:0.0:1787782104.556437:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069568 00000100:00100000:0.0:1787782104.556478:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782104.556485:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+13:17941:x1874624963069568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782104.556495:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782104.556504:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82167600/0xc6d6745c15064555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506454e expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.556529:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82167600/0xc6d6745c15064555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506454e expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.556538:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82167600/0xc6d6745c15064555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506454e expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.556546:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167600, rc 0) 00000100:00100000:0.0:1787782104.556585:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+14:17941:x1874624963069568:12345-0@lo:101:mount.lustre.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.556591:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787782104.556728:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782104.556740:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064555 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.556753:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064555 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.556764:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787782104.562308:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064555 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.562326:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43705800/0xc6d6745c1506454e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064555 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.562335:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787782104.562345:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782104.562352:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff993d67ccb800 10000000:01000000:3.0:1787782104.562355:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787782104.562359:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787782104.562362:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787782104.562401:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.562409:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.562420:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.562445:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782104.562516:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.562563:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.563069:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069696 00000100:00100000:1.0:1787782104.563078:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069696 00000100:00100000:1.0:1787782104.563132:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787782104.563142:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+14:17941:x1874624963069696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782104.563155:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782104.563184:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfac00/0xc6d6745c15064563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506455c expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.563208:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfac00/0xc6d6745c15064563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506455c expref: 15 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.563220:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfac00/0xc6d6745c15064563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506455c expref: 15 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.563244:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfac00, rc 0) 00000100:00100000:1.0:1787782104.563316:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963069696:12345-0@lo:101:mount.lustre.0 Request processed in 175us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782104.563323:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787782104.563555:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782104.563571:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064563 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.563580:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064563 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782104.565318:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787782104.570574:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782104.580040:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787782104.580100:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787782104.580116:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787782104.580130:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787782104.580143:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787782104.580156:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787782104.580183:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787782104.580199:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787782104.580212:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787782104.580224:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787782104.580249:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787782104.580267:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787782104.580282:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787782104.580294:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787782104.580322:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787782104.580336:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787782104.580354:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787782104.580366:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787782104.580377:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787782104.580390:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787782104.580403:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787782104.580415:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787782104.580428:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787782104.580454:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787782104.580465:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787782104.580563:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782104.580659:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.580691:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.580751:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069824 00000100:00100000:0.0:1787782104.580757:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069824 00000100:00100000:0.0:1787782104.580809:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782104.580818:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963069824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782104.580962:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963069824:12345-0@lo:501:mount.lustre.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.580970:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787782104.581207:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.581243:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782104.581283:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.581319:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.581341:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963069952 00000100:00100000:0.0:1787782104.581346:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963069952 00000100:00100000:0.0:1787782104.581380:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787782104.581388:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963069952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782104.582730:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963069952:12345-0@lo:503:mount.lustre.0 Request processed in 1336us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.582741:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782104.582970:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963069952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787782104.583431:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787782104.583519:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963070080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782104.583566:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.583657:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d770e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.584250:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070080 00000100:00100000:2.0:1787782104.584258:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070080 00000100:00100000:2.0:1787782104.584321:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787782104.584331:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963070080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782104.585074:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963070080:12345-0@lo:502:mount.lustre.0 Request processed in 742us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.585083:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782104.585206:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963070080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782104.585466:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787782104.585498:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1787782104.585512:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1787782104.585525:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1787782104.585551:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1787782104.585568:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1787782104.585582:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1787782104.585594:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1787782104.585645:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1787782104.585662:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1787782104.585676:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1787782104.585689:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1787782104.585703:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1787782104.585716:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1787782104.585730:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1787782104.585742:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1787782104.585755:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1787782104.585769:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1787782104.585783:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1787782104.585812:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1787782104.585827:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1787782104.585841:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787782104.586565:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787782104.586594:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787782104.586635:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787782104.586652:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787782104.586667:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787782104.586682:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787782104.586693:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787782104.586707:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787782104.586722:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787782104.586735:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787782104.586748:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787782104.586760:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787782104.586771:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787782104.586782:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787782104.586810:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787782104.586826:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787782104.586839:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787782104.586864:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787782104.586880:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787782104.586894:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787782104.586909:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787782104.586923:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787782104.586967:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963070208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782104.587046:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.587091:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f51cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782104.587223:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070208 00000100:00100000:3.0:1787782104.587231:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070208 00000100:00100000:3.0:1787782104.587287:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782104.587296:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963070208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782104.587428:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963070208:12345-0@lo:502:mount.lustre.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.587435:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787782104.587781:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963070208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782104.587861:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1787782104.587875:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787782104.591956:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.591970:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.591984:0:17945:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787782104.591991:0:17945:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787782104.591994:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782104.592010:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff993d7aec8000) 00000020:00000080:3.0:1787782104.592032:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787782104.592038:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787782104.592123:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787782104.592131:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15064571 00000020:00000080:3.0:1787782104.592361:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787782104.592367:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782104.592370:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.592372:0:17945:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787782104.592375:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.592379:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.592380:0:17945:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787782104.592383:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782104.592390:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff993d7aec99b8) 00000020:00000080:3.0:1787782104.592402:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787782104.592406:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787782104.592408:0:17945:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787782104.592411:0:17945:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787782104.592416:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782104.592474:0:17945:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d67ccb800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787782104.592487:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff993d7aecb370) 00000020:00000080:3.0:1787782104.592497:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787782104.592547:0:17945:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787782104.592553:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15064586 00000020:00000080:3.0:1787782104.593020:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787782104.593029:0:17945:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787782104.593035:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc6d6745c1506458d 00080000:01000000:3.0:1787782104.593041:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787782104.593045:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c15064594 00010000:00010000:3.0:1787782104.714131:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787782104.715598:0:17945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787782104.716091:0:17945:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787782104.717503:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787782104.717516:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782104.717522:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.717524:0:17945:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787782104.717528:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.717534:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.717535:0:17945:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787782104.717538:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787782104.717544:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:00000080:3.0:1787782104.717570:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782104.717593:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff993d449619b8) 00000020:00000080:3.0:1787782104.717661:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787782104.717669:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787782104.717731:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787782104.717738:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787782104.717744:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c150645a2 00010000:00080000:3.0:1787782104.717777:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d67f96000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787782104.721032:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787782104.725014:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787782104.725034:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787782104.725078:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787782104.725102:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c150645a9 00000100:00080000:3.0:1787782104.725113:0:17945:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787782104.725119:0:17945:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff993d67f96000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782104.725154:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d491603c0 x1874624963070336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782104.725199:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787782104.725327:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782104.725344:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725346:0:17945:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787782104.725350:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787782104.725352:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787782104.725354:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782104.725355:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782104.725356:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787782104.725359:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725360:0:17945:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787782104.725363:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.725367:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725368:0:17945:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787782104.725372:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787782104.725406:0:17945:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787782104.725420:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782104.725424:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725425:0:17945:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787782104.725427:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787782104.725429:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787782104.725430:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782104.725432:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782104.725434:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787782104.725436:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725437:0:17945:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787782104.725439:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787782104.725443:0:17945:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787782104.725446:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.725448:0:17945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787782104.725450:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787782104.725454:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:3.0:1787782104.725477:0:17945:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787782104.725480:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782104.725492:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff993d44963370) 00000020:00000080:3.0:1787782104.725504:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787782104.725516:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787782104.725590:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787782104.725596:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787782104.725602:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c150645b7 00010000:00080000:3.0:1787782104.725663:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d487d1800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:3.0:1787782104.725893:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787782104.726413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782104.726485:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.726563:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070336 00000100:00100000:0.0:1787782104.726571:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070336 00000100:00100000:0.0:1787782104.726627:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782104.726635:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963070336:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787782104.726661:0:17215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1787782104.726705:0:17215:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c150645be 00000004:00100000:0.0:1787782104.726721:0:17215:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787782104.726735:0:17215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1787782104.728330:0:17945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787782104.728886:0:17945:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787782104.730717:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787782104.731068:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787782104.731091:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787782104.731095:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782104.731103:0:14356:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:2.0:1787782104.731109:0:14356:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787782104.731116:0:14356:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff993d49f00800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782104.731150:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd8000 x1874624963070464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782104.731192:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.731196:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782104.731198:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.731201:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782104.731249:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963070592:0@lo:400:kworker.0 00000100:00100000:2.0:1787782104.731322:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.731459:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963070464:0@lo:38:kworker.0 00000100:00100000:1.0:1787782104.731492:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.731573:0:17214:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787782104.731581:0:17214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787782104.731869:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070592 00000100:00100000:0.0:1787782104.731876:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070592 00000100:00100000:0.0:1787782104.731923:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782104.731933:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963070592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.731996:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963070592:12345-0@lo:400:kworker.0 Request processed in 64us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.732004:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782104.732049:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff993d67fd9680 x1874624963070592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782104.732064:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963070592:0@lo:400:kworker.0 00000040:00080000:0.0:1787782104.732111:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787782104.733060:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1787782104.735004:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070464 00000100:00100000:3.0:1787782104.735017:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070464 00000100:00100000:3.0:1787782104.735475:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782104.735494:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963070464:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787782104.735632:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1874624963070464:12345-0@lo:38:kworker.0 Request processed in 121us (4113us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787782104.735641:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782104.735711:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787782104.735719:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782104.735724:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787782104.735728:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963070464:0@lo:38:kworker.0 00000040:00080000:1.0:1787782104.745782:0:17951:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787782104.745792:0:17951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1787782104.748072:0:17215:0:(import.c:65:import_set_state_nolock()) ffff993c41faa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782104.748177:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624963070336:12345-0@lo:38:llog_process_th.0 Request processed in 21538us (21688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.748188:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782104.748282:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782104.748290:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787782104.748308:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787782104.748313:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782104.748316:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67f96000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782104.748334:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782104.748797:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963070720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782104.748840:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.748994:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963070720 00000100:00100000:2.0:1787782104.749001:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963070720 00000100:00100000:2.0:1787782104.749046:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782104.749056:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963070720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787782104.749082:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787782104.749123:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874624963070720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.749143:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782104.749221:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963070720:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1787782104.749819:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787782104.749840:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787782104.750252:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787782104.750274:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c150645c5 00000100:00080000:1.0:1787782104.750283:0:17945:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782104.750289:0:17945:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff993d487d1800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782104.750330:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e40f00 x1874624963070848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782104.750356:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787782104.750414:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782104.750418:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782104.750421:0:17945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787782104.750424:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787782104.750426:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787782104.750428:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782104.750429:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782104.750431:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787782104.750433:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782104.750435:0:17945:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787782104.750437:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782104.750441:0:17945:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787782104.750445:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782104.750446:0:17945:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787782104.750449:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787782104.750452:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.116@tcp to nid 0x20000c0a8ce74 (192.168.206.116@tcp) 00000020:01000000:1.0:1787782104.750473:0:17945:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787782104.750476:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782104.750487:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff993c437e4d28) 00000020:00000080:1.0:1787782104.750499:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787782104.750510:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787782104.750575:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787782104.750581:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787782104.750587:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc6d6745c150645d3 00010000:00080000:1.0:1787782104.750635:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d4bec6800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.116@tcp at head 00000100:00080000:2.0:1787782104.750800:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.750805:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782104.750808:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.750810:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787782104.751070:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787782104.751133:0:17945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787782104.751151:0:17945:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1787782104.751474:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070848:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787782104.751522:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963070848 offset 0 length 520: 4 00000040:00080000:1.0:1787782104.753892:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782104.754208:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787782104.754365:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787782104.754880:0:17953:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787782104.754886:0:17953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787782104.755517:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787782104.755529:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787782104.755564:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787782104.755584:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c150645da 00000100:00080000:1.0:1787782104.755594:0:17945:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782104.755601:0:17945:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782104.756559:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a7c00 x1874624963070976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782104.756654:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070976:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787782104.756721:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963070976 offset 0 length 520: 4 00000100:00080000:0.0:1787782104.756827:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787782104.757029:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.757034:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782104.757037:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782104.757040:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787782104.757128:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782104.757135:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782104.757137:0:17945:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787782104.757140:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782104.757144:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782104.757146:0:17945:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787782104.757149:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787782104.757151:0:17945:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787782104.757153:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782104.757155:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782104.757157:0:17945:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787782104.757159:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782104.757161:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782104.757162:0:17945:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787782104.757167:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787782104.757195:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782104.757199:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782104.757201:0:17945:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787782104.757204:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1787782104.757354:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787782104.757389:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787782104.757409:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064563 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.757420:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704c00/0xc6d6745c1506455c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064563 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782104.757429:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d67ccb800 from 1 10000000:01000000:1.0:1787782104.757432:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787782104.757457:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.757476:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.757487:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782104.757510:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782104.757549:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.757576:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67f513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.758998:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071104 00000100:00100000:0.0:1787782104.759011:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071104 00000100:00100000:0.0:1787782104.759068:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787782104.759077:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+15:17941:x1874624963071104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782104.759092:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782104.759108:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150645e1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.759145:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.759157:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.759166:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:0.0:1787782104.759224:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17941:x1874624963071104:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.759231:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787782104.759351:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782104.759368:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.759377:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782104.759969:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071232:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787782104.760014:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.760049:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.760188:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071232 00000100:00100000:0.0:1787782104.760194:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071232 00000100:00100000:0.0:1787782104.760236:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787782104.760244:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17941:x1874624963071232:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787782104.760259:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787782104.760324:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787782104.760328:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787782104.760407:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17941:x1874624963071232:12345-0@lo:256:mount.lustre.0 Request processed in 163us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.760415:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787782104.760548:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071232:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787782104.761749:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787782104.761809:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.761832:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782104.761840:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d67ccb800 from 1 10000000:01000000:2.0:1787782104.761843:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782104.761882:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.761890:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.761900:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782104.761921:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782104.761968:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.762010:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.762152:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071360 00000100:00100000:0.0:1787782104.762159:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071360 00000100:00100000:0.0:1787782104.762215:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782104.762224:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17941:x1874624963071360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782104.762236:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782104.762248:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150645ef expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.762283:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.762293:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.762312:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166200, rc 0) 00000100:00100000:0.0:1787782104.762350:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071360:12345-0@lo:101:mount.lustre.0 Request processed in 127us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.762357:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787782104.762503:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782104.762517:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.762525:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782104.762687:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782104.762719:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782104.762748:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.762775:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.762833:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071488 00000100:00100000:0.0:1787782104.762838:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071488 00000100:00100000:0.0:1787782104.762879:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787782104.762885:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782104.763320:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071488:12345-0@lo:501:mount.lustre.0 Request processed in 434us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.763328:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787782104.763419:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.763454:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782104.763499:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.763531:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.764031:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071616 00000100:00100000:0.0:1787782104.764039:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071616 00000100:00100000:0.0:1787782104.764076:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787782104.764083:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782104.764190:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071616:12345-0@lo:503:mount.lustre.0 Request processed in 106us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.764198:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787782104.764286:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787782104.764689:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787782104.764775:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782104.764819:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.764863:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.764993:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071744 00000100:00100000:0.0:1787782104.764998:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071744 00000100:00100000:0.0:1787782104.765032:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787782104.765040:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782104.765129:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071744:12345-0@lo:502:mount.lustre.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.765136:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787782104.767126:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782104.767429:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787782104.767462:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787782104.767478:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787782104.767492:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787782104.767506:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787782104.767520:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787782104.767535:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787782104.767549:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787782104.767563:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787782104.767576:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787782104.767588:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787782104.767655:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782104.767726:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.767765:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.767871:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963071872 00000100:00100000:0.0:1787782104.767878:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963071872 00000100:00100000:0.0:1787782104.767923:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787782104.767931:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782104.768042:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963071872:12345-0@lo:502:mount.lustre.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.768049:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782104.768252:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963071872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782104.768308:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1787782104.768318:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787782104.771484:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.771500:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.771503:0:17955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787782104.771513:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d67ccb800 00000020:00000080:3.0:1787782104.771516:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782104.771525:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782104.771528:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.771530:0:17955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787782104.771532:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782104.771549:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782104.771550:0:17955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787782104.771554:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d67ccb800 00000020:00000080:3.0:1787782104.771557:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782104.771945:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782104.774875:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782104.774882:0:17955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787782104.774893:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782104.774900:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782104.774902:0:17955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782104.774908:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d67ccb800 00000020:00000080:2.0:1787782104.774911:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787782104.774966:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782104.774970:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782104.774971:0:17955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782104.774974:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782104.774976:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782104.774977:0:17955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787782104.774981:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d67ccb800 00000020:00000080:2.0:1787782104.774983:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787782104.775025:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782104.775028:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782104.775029:0:17955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787782104.775033:0:17955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787782104.775177:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787782104.775214:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782104.775231:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775244:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782104.775303:0:17941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782104.775307:0:17941:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d67ccb800 10000000:01000000:2.0:1787782104.775310:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d67ccb800 10000000:01000000:2.0:1787782104.775314:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782104.775327:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d67ccb800 from 1 10000000:01000000:2.0:1787782104.775330:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782104.775363:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775371:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775382:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782104.775404:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782104.775465:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.775505:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072000 00000100:00100000:2.0:1787782104.775511:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072000 00000100:00100000:2.0:1787782104.775551:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787782104.775560:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17941:x1874624963072000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782104.775573:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782104.775584:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e4600/0xc6d6745c15064604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150645fd expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775630:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e4600/0xc6d6745c15064604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150645fd expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775642:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e4600/0xc6d6745c15064604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150645fd expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775651:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4600, rc 0) 00000100:00100000:2.0:1787782104.775684:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072000:12345-0@lo:101:mount.lustre.0 Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.775699:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787782104.775745:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.775765:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782104.775778:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064604 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.775788:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064604 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782104.784683:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787782104.785547:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782104.785782:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787782104.785809:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787782104.785823:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787782104.785837:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787782104.788162:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787782104.793795:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787782104.793830:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787782104.793849:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787782104.793863:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787782104.793875:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787782104.793888:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787782104.793902:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787782104.793919:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787782104.793939:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787782104.793977:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787782104.793996:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787782104.794015:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787782104.794049:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787782104.794067:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787782104.794081:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787782104.794098:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787782104.794124:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787782104.794146:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787782104.794184:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787782104.794216:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787782104.794242:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787782104.794295:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787782104.794326:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787782104.794359:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787782104.794366:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787782104.794491:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.794558:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.794626:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787782104.795774:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072128 00000100:00100000:3.0:1787782104.795784:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072128 00000100:00100000:3.0:1787782104.795843:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782104.795854:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.795990:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072128:12345-0@lo:501:mount.lustre.0 Request processed in 138us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.795998:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782104.796450:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782104.796498:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782104.796684:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.796717:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072256 00000100:00100000:3.0:1787782104.796721:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072256 00000100:00100000:3.0:1787782104.797018:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782104.797027:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782104.797136:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072256:12345-0@lo:503:mount.lustre.0 Request processed in 110us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.797143:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787782104.802368:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4379b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.802409:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787782104.804258:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782104.804378:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782104.804457:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.804516:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072384 00000100:00100000:2.0:1787782104.804522:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072384 00000100:00100000:2.0:1787782104.804575:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782104.804585:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782104.804723:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072384:12345-0@lo:502:mount.lustre.0 Request processed in 139us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.804732:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782104.804787:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d47ec3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.804809:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782104.806596:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787782104.806671:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787782104.806703:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787782104.806723:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787782104.806743:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787782104.806761:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787782104.806776:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787782104.806790:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787782104.806807:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787782104.806825:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787782104.806841:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787782104.806876:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787782104.806893:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787782104.806907:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787782104.806939:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787782104.806956:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787782104.806973:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787782104.806991:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787782104.807008:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787782104.807021:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787782104.807035:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787782104.807048:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787782104.807059:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787782104.807073:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787782104.807087:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787782104.807099:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787782104.807112:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787782104.807126:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787782104.807138:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787782104.807152:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787782104.808562:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787782104.808594:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787782104.808628:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787782104.808646:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787782104.808660:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787782104.808692:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787782104.808709:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787782104.808724:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787782104.808741:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787782104.808757:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787782104.808771:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787782104.808787:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787782104.808804:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787782104.808820:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787782104.808836:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787782104.809775:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787782104.809826:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787782104.809929:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787782104.810012:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782104.810104:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.810383:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d47ec3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.810447:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072512 00000100:00100000:1.0:1787782104.810454:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072512 00000100:00100000:1.0:1787782104.810508:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787782104.810522:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782104.814796:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072512:12345-0@lo:502:mount.lustre.0 Request processed in 4269us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782104.814811:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787782104.814990:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782104.815333:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787782104.815363:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787782104.815399:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782104.815450:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.816400:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782104.820113:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072640 00000100:00100000:3.0:1787782104.820133:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072640 00000100:00100000:3.0:1787782104.820225:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787782104.820243:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782104.820547:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072640:12345-0@lo:502:mount.lustre.0 Request processed in 306us (5097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.820556:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787782104.820714:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782104.820809:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787782104.820824:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787782104.833543:0:17961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787782104.833562:0:17961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff993c437e19b8) 00000020:00000080:1.0:1787782104.833585:0:17961:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787782104.833743:0:17961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d67ccb800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787782104.833747:0:17961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d67ccb800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787782104.833749:0:17961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d67ccb800 3 00010000:00080000:1.0:1787782104.833780:0:17961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c4442f800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787782104.838164:0:17961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787782104.838423:0:17961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787782104.838479:0:17961:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787782104.838500:0:17961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc6d6745c15064612 00000100:00080000:1.0:1787782104.838510:0:17961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782104.838516:0:17961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff993c4442f800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782104.838549:0:17961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e43480 x1874624963072768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782104.838571:0:17961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787782104.838599:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782104.838604:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782104.838631:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782104.838634:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787782104.839823:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963072768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782104.839908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.839994:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072768 00000100:00100000:0.0:1787782104.840003:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072768 00000100:00100000:0.0:1787782104.840092:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782104.840100:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963072768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787782104.840181:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1787782104.840407:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc6d6745c15064619 00000004:00100000:0.0:1787782104.840423:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787782104.840526:0:17211:0:(import.c:65:import_set_state_nolock()) ffff993d770b5000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787782104.840546:0:17961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:0.0:1787782104.840595:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874624963072768:12345-0@lo:38:llog_process_th.0 Request processed in 494us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.840603:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1787782104.840746:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787782104.840785:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782104.840808:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064604 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782104.840819:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e4200/0xc6d6745c150645fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064604 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787782104.840868:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff993c43e43480 x1874624963072768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:2.0:1787782104.840870:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787782104.840874:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787782104.840877:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782104.840880:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782104.840883:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782104.840887:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782104.840888:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:3.0:1787782104.840889:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000020:01000004:2.0:1787782104.840890:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782104.840892:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1787782104.840901:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 10000000:01000000:2.0:1787782104.840902:0:17941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787782104.840907:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782104.840908:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787782104.840909:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782104.840910:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00080000:3.0:1787782104.840911:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000020:01000004:2.0:1787782104.840912:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782104.840914:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782104.840917:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782104.840918:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00080000:3.0:1787782104.840919:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000020:01000004:2.0:1787782104.840919:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1787782104.840925:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4442f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787782104.840932:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874624963072768:0@lo:38:llog_process_th.0 10000000:01000000:2.0:1787782104.840943:0:17941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787782104.840962:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782104.841005:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.841030:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d05a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.841761:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963072896 00000100:00100000:1.0:1787782104.841771:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963072896 00000100:00100000:1.0:1787782104.841852:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787782104.841863:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782104.841891:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787782104.841906:0:17204:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787782104.845583:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787782104.845633:0:17204:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787782104.845643:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787782104.846560:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787782104.846568:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787782104.846594:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.846636:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506451d expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.846644:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.846651:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.846690:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.846705:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 18 pid: 17201 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782104.846718:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963073024:0@lo:104: 00000100:00100000:1.0:1787782104.846786:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782104.847652:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.847664:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 18 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782104.847674:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963073152:0@lo:104: 00000100:00100000:1.0:1787782104.847715:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.847737:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67ff76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.847758:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073024 00000100:00100000:1.0:1787782104.847764:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073024 00000100:00100000:1.0:1787782104.847799:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073152 00000100:00100000:1.0:1787782104.847801:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073152 00000100:00100000:3.0:1787782104.847817:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782104.847831:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963073024:12345-0@lo:104: 00010000:00010000:3.0:1787782104.847844:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.847904:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782104.847911:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963073024:12345-0@lo:104: Request processed in 84us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782104.848489:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17941:x1874624963072896:12345-0@lo:253:mount.lustre.0 Request processed in 6626us (7481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782104.848499:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787782104.848556:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17941:1874624963072896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787782104.848568:0:17941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787782104.848571:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782104.848573:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787782104.848574:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782104.848576:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782104.848577:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782104.848578:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782104.848579:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787782104.848581:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782104.848582:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787782104.848597:0:17941:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787782104.849784:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963073024:0@lo:104: 00000100:00100000:3.0:1787782104.850098:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782104.850132:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782104.850145:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963073152:12345-0@lo:104: 00010000:00010000:3.0:1787782104.850277:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850383:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787782104.850391:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963073152:12345-0@lo:104: Request processed in 251us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.850400:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787782104.850425:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782104.850432:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850440:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfaa00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782104.850445:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850455:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782104.850463:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.850469:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782104.850514:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850521:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782104.850541:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850548:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150645e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645e8 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850566:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782104.850569:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850575:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782104.850578:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850585:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782104.850592:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782104.850597:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782104.850629:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850635:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782104.850652:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850659:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43dfa000/0xc6d6745c1506451d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064524 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.850671:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782104.850673:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782104.850675:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782104.850681:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782104.851356:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963073280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782104.851404:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.851457:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782104.851465:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963073408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782104.851491:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.851521:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073280 00000100:00100000:3.0:1787782104.851528:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073280 00010000:00010000:3.0:1787782104.851554:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 18 pid: 17201 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.851577:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073408 00000100:00100000:3.0:1787782104.851580:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073408 00010000:00010000:3.0:1787782104.851591:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 19 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.851603:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782104.851628:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:3658:x1874624963073280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782104.851641:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782104.851646:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 19 pid: 17201 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.851658:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 19 pid: 17201 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.851672:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82167e00/0xc6d6745c150645e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150645e1 expref: 19 pid: 17201 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.851686:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782104.852416:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3658:x1874624963073280:12345-0@lo:103:ldlm_bl.0 Request processed in 786us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.852441:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782104.852461:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782104.852468:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:3660:x1874624963073408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782104.852478:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782104.852484:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 17 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852494:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 17 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852508:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852516:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787782104.852530:0:17194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005963718s 00010000:00010000:3.0:1787782104.852534:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852541:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852548:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852555:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852560:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787782104.852571:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852579:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852588:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852599:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782104.852659:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:3660:x1874624963073408:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.852666:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782104.852720:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963073408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782104.852755:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705400/0xc6d6745c15064524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506451d expref: 16 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782104.852765:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963073152:0@lo:104: 00010000:00010000:3.0:1787782104.852780:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852788:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852794:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782104.852800:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064620 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782104.852994:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963073280:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1787782104.860435:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787782104.860453:0:17966:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787782104.860458:0:17966:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787782104.861112:0:17967:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787782104.861323:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1787782104.861549:0:17967:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782104.865153:0:17967:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787782104.865235:0:17967:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787782104.869524:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.869998:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.870165:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5540 going to sleep for 11 seconds 00000040:01000000:3.0:1787782104.871992:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787782104.872035:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787782104.872753:0:17941:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787782104.872763:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1787782104.872815:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073536 00000100:00100000:2.0:1787782104.872826:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073536 00000040:00080000:3.0:1787782104.872913:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782104.875338:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787782104.876324:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787782104.876368:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787782104.876475:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782104.876714:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782104.876741:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787782104.876858:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 122us (6860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.876867:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782104.876914:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073536:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787782104.876949:0:17968:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787782104.876987:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.877026:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1787782104.877656:0:17941:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1787782104.878362:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.881848:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073664 00000100:00100000:2.0:1787782104.881861:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073664 00000100:00100000:2.0:1787782104.881933:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782104.881943:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787782104.883266:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1311us (6225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.883279:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782104.884360:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073664:0@lo:1000:lod0001_rec0000.0 00000001:00000004:2.0:1787782104.886071:0:17941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787782104.887008:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17968:1874624963073792:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.887367:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782104.887560:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073792 00000100:00100000:2.0:1787782104.887569:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073792 00000100:00100000:1.0:1787782104.887749:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782104.887869:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782104.887881:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1874624963073792:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787782104.887955:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1874624963073792:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.887962:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782104.888159:0:17968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff993c43e41680 x1874624963073792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787782120 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782104.888172:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17968:1874624963073792:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.888230:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.888274:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.888308:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963073920 00000100:00100000:1.0:1787782104.888312:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963073920 00000100:00100000:1.0:1787782104.888344:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787782104.888351:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787782104.888416:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17968:x1874624963073920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782104.888435:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787782104.888454:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782104.888476:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1874624963073920:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787782104.888517:0:17968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782104.892092:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787782104.892172:0:17968:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787782104.892177:0:17968:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1787782104.895514:0:17941:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787782104.895554:0:17941:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffabe2856af988 00100000:10000000:3.0:1787782104.895562:0:17941:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787782104.896545:0:17941:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787782104.896580:0:17941:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787782104.896598:0:17941:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787782104.896633:0:17941:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787782104.901678:0:17941:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787782104.901956:0:17941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787782105.159560:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782105.478790:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782105.867009:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787782106.186452:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 10000000:01000000:0.0:1787782106.245725:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782106.245732:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d67ccb800 from 8 10000000:01000000:0.0:1787782106.245737:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782106.245784:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.245796:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.245807:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782106.245832:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782106.245898:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782106.245960:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782106.246084:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074048 00000100:00100000:3.0:1787782106.246091:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074048 00000100:00100000:3.0:1787782106.246155:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787782106.246164:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17206:x1874624963074048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782106.246176:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782106.246188:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064627 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782106.246208:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064627 expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782106.246218:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064627 expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782106.246227:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705400, rc 0) 00000100:00100000:3.0:1787782106.246276:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963074048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782106.246283:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782106.246549:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782106.246561:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.246570:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782106.246644:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782106.246674:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782106.246699:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782106.246752:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074176 00000100:00100000:1.0:1787782106.246757:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074176 00000100:00100000:1.0:1787782106.246796:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787782106.246804:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963074176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782106.246817:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782106.246830:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782106.246833:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787782106.246914:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963074176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782106.246921:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787782106.247113:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787782106.247155:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782106.247161:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.247170:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782106.247179:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782106.247181:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993c4442b000 from 8 10000000:01000000:0.0:1787782106.247184:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782106.247201:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.247208:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.247215:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782106.247227:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782106.247252:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782106.247282:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782106.247451:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074304 00000100:00100000:2.0:1787782106.247456:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074304 00000100:00100000:2.0:1787782106.247490:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787782106.247498:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963074304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782106.247506:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782106.247516:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064635 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782106.247532:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064635 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782106.247541:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064635 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782106.247548:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4c00, rc 0) 00000100:00100000:2.0:1787782106.247587:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963074304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782106.247594:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787782106.247828:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782106.247839:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.247846:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782106.247889:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782106.247916:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782106.247943:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782106.247995:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074432 00000100:00100000:3.0:1787782106.247999:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074432 00000100:00100000:3.0:1787782106.248028:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787782106.248036:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963074432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787782106.248047:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787782106.248059:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787782106.248062:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787782106.248141:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963074432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782106.248147:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787782106.248215:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963074432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787782106.248248:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782106.248254:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782106.248272:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782106.507302:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782106.887463:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782107.208950:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782107.525809:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782108.231517:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782108.550647:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782109.257454:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787782109.574777:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782109.942343:0:18211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787782110.214526:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963074560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782110.214596:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.214737:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074560 00000100:00100000:0.0:1787782110.214744:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074560 00000100:00100000:0.0:1787782110.214788:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782110.214796:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963074560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787782110.214827:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782110.214869:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963074560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.214876:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782110.214915:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963074560:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787782110.215570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782110.215582:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787782110.215585:0:8:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782110.215592:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff993d49f00800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782110.216020:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963074688:0@lo:400:kworker.0 00000100:00100000:1.0:1787782110.216064:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782110.216166:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074688 00000100:00100000:3.0:1787782110.216173:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074688 00000100:00100000:3.0:1787782110.216212:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787782110.216220:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3657:x1874624963074688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782110.216279:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3657:x1874624963074688:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782110.216287:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787782110.216326:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963074688:0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.216715:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a4780 x1874624963074816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782110.216738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782110.216742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782110.216745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782110.216747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782110.216765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782110.216768:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782110.216771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782110.216773:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782110.216802:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963074944:0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.216834:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.216864:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074944 00000100:00100000:0.0:1787782110.216868:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074944 00000100:00100000:0.0:1787782110.216898:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782110.216905:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.216942:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963074944:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.216948:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787782110.216973:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c431a61c0 x1874624963074944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782110.216993:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963074944:0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.217017:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782110.217025:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963075072:0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.217053:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.217076:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075072 00000100:00100000:0.0:1787782110.217079:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075072 00000100:00100000:0.0:1787782110.217099:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782110.217106:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963075072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782110.217139:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963075072:12345-0@lo:400:kworker.0 Request processed in 33us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.217145:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787782110.217169:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c431a6d00 x1874624963075072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782110.217179:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963075072:0@lo:400:kworker.0 00000100:00100000:3.0:1787782110.218086:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963074816:0@lo:38:kworker.0 00000100:00100000:3.0:1787782110.218136:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782110.218681:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963074816 00000100:00100000:2.0:1787782110.218689:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963074816 00000100:00100000:2.0:1787782110.218718:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782110.218724:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1874624963074816:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787782110.218748:0:17215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:2.0:1787782110.218780:0:17215:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15064643 00000004:00100000:2.0:1787782110.218794:0:17215:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787782110.218799:0:17215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787782110.240114:0:17215:0:(import.c:65:import_set_state_nolock()) ffff993c41fa8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782110.240232:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624963074816:12345-0@lo:38:kworker.0 Request processed in 21506us (22096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782110.240243:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787782110.240320:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787782110.240329:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787782110.240335:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787782110.240338:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d49f00800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787782110.240361:0:3656:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008913199b): req@ffff993d67fd9e00 x1874624963067776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782110.240378:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963074816:0@lo:38:kworker.0 00000100:00100000:2.0:1787782110.240445:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782110.240470:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782110.244529:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782110.245423:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963067776 00000100:00100000:0.0:1787782110.245432:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963067776 00000100:00100000:0.0:1787782110.245483:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782110.245493:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963067776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787782110.245624:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963067776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.245632:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782110.245918:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1874624963067776:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787782110.245956:0:17252:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787782110.245998:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1874624963075328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787782110.246047:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.246080:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782110.246094:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075328 00000100:00100000:0.0:1787782110.246098:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075328 00000100:00100000:0.0:1787782110.246122:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782110.246128:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963075328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787782110.246227:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963075328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782110.246387:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963075200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787782110.246418:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.247621:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782110.247652:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075200 00000100:00100000:0.0:1787782110.247660:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075200 00000100:00100000:0.0:1787782110.247690:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782110.247699:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963075200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787782110.247733:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787782110.247851:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963075200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.247859:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782110.247910:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1874624963075328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787782110.247972:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963075200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787782110.248953:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1874624963075456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787782110.248999:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782110.249020:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782110.249036:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075456 00000100:00100000:0.0:1787782110.249041:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075456 00000100:00100000:0.0:1787782110.249073:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782110.249080:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963075456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787782110.249146:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1874624963075456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.249158:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782110.254027:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1874624963075456:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787782110.254092:0:17252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782110.263028:0:17252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787782110.263120:0:17252:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1787782110.263126:0:17252:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787782110.599095:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787782110.919596:0:18264:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787782110.919770:0:18264:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787782111.626122:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787782112.055063:0:18314:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787782112.056986:0:18314:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787782112.262303:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787782112.645761:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782112.960143:0:18363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdebcf80e0 20000000:00000080:0.0:1787782112.960160:0:18363:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993d44bd4800 uarg=0000000000000000 20000000:01000000:0.0:1787782112.960198:0:18363:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787782112.960205:0:18363:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787782112.960209:0:18363:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787782112.960677:0:18364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787782112.960759:0:18363:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787782112.969189:0:18363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787782112.969219:0:18363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.969237:0:18363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150644ec expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.969245:0:18363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.969266:0:18363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.969308:0:18363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.969323:0:18363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782112.969349:0:18363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18363:1874624963075584:0@lo:104: 00000100:00100000:0.0:1787782112.969412:0:18363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787782112.970435:0:18363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.970448:0:18363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 17 pid: 17201 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782112.970462:0:18363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18363:1874624963075712:0@lo:104: 00000100:00100000:0.0:1787782112.970503:0:18363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782112.970618:0:18363:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d46578840 going to sleep for 11 seconds 00000100:00100000:3.0:1787782112.973239:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075584 00000100:00100000:3.0:1787782112.973264:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075584 00000100:00100000:3.0:1787782112.973315:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075712 00000100:00100000:3.0:1787782112.973318:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075712 00000100:00100000:3.0:1787782112.973334:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782112.973343:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:18363:x1874624963075584:12345-0@lo:104: 00010000:00010000:3.0:1787782112.973359:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973500:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782112.973506:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:18363:x1874624963075584:12345-0@lo:104: Request processed in 165us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782112.973523:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782112.973541:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782112.973558:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:18363:x1874624963075712:12345-0@lo:104: 00010000:00010000:3.0:1787782112.973567:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973620:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787782112.973636:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:18363:x1874624963075712:12345-0@lo:104: Request processed in 90us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782112.973642:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787782112.973662:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782112.973668:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973675:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782112.973679:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973687:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782112.973694:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782112.973700:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782112.973736:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973742:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782112.973769:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973777:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d412e4000/0xc6d6745c150645ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150645f6 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973790:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782112.973793:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973799:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:3.0:1787782112.973801:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973807:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782112.973825:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782112.973830:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782112.973844:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973850:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782112.973856:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973861:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82167a00/0xc6d6745c150644ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150644f3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.973884:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782112.973886:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782112.973887:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782112.973907:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963075840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782112.973947:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782112.973984:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782112.973990:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963075968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782112.974011:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782112.974046:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075840 00000100:00100000:3.0:1787782112.974051:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075840 00010000:00010000:3.0:1787782112.974070:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 18 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782112.974089:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963075968 00000100:00100000:3.0:1787782112.974092:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963075968 00010000:00010000:3.0:1787782112.974103:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 19 pid: 17201 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782112.974114:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782112.974120:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:3657:x1874624963075840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782112.974131:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782112.974136:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 19 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974146:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 19 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974162:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782112.974196:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:3657:x1874624963075840:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782112.974204:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782112.974217:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782112.974223:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3657:x1874624963075968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782112.974230:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782112.974234:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 18 pid: 17201 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974243:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 18 pid: 17201 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974266:0:17195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974274:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974288:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974295:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974302:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974310:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974315:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787782112.974324:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974332:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974341:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782112.974350:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782112.974373:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3657:x1874624963075968:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782112.974380:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782112.974416:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963075968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782112.974424:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963075840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782112.974974:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782112.975127:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166200/0xc6d6745c150645f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150645ef expref: 17 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782112.975145:0:18363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18363:1874624963075584:0@lo:104: 00010000:00010000:0.0:1787782112.975156:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d82166400/0xc6d6745c150644f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150644ec expref: 16 pid: 17201 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782112.975164:0:18363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18363:1874624963075712:0@lo:104: 00010000:00010000:0.0:1787782112.975182:0:18363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.975192:0:18363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.975198:0:18363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782112.975219:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f9a00/0xc6d6745c1506464a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782113.671044:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782114.309783:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782104/real 1787782104] req@ffff993c431a7c00 x1874624963070976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782114.309816:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c431a7c00 x1874624963070976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782114.309828:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782104/real 1787782104] req@ffff993c43e40f00 x1874624963070848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782114.309840:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c43e40f00 x1874624963070848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787782114.309857:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782114.309876:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782114.309880:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070976:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787782114.309886:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d487d1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782114.309891:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782114.309910:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963070848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787782114.310123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782114.310128:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782114.310130:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782114.310134:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782114.310160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782114.310169:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787782114.310171:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d487d1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782114.310176:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1787782114.310182:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787782114.310188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff993d487d1800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782114.310207:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd9680 x1874624963076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782114.310220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782114.310223:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787782114.310225:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782114.310228:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1787782114.310231:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787782114.310234:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782114.310254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fdb480 x1874624963076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782114.310287:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963076352:0@lo:400:kworker.0 00000100:00100000:2.0:1787782114.310344:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782114.310374:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782114.310380:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963076480:0@lo:400:kworker.0 00000100:00100000:2.0:1787782114.310431:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.310636:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963076096:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.310669:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.310700:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963076864:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.310722:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.310738:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782114.310744:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963076224:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.310764:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782114.310877:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076352 00000100:00100000:0.0:1787782114.310885:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076352 00000100:00100000:0.0:1787782114.310924:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076864 00000100:00100000:0.0:1787782114.310927:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076864 00000100:00100000:0.0:1787782114.310940:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782114.310947:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963076352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782114.311001:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963076352:12345-0@lo:400:kworker.0 Request processed in 53us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782114.311008:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782114.311025:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782114.311032:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782114.311065:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963076864:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782114.311071:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782114.311098:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076480 00000100:00100000:0.0:1787782114.311102:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076480 00000100:00100000:0.0:1787782114.311123:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076224 00000100:00100000:0.0:1787782114.311126:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076224 00000100:00100000:0.0:1787782114.311137:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782114.311142:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782114.311175:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963076480:12345-0@lo:400:kworker.0 Request processed in 32us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782114.311181:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782114.311201:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782114.311207:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963076224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782114.311237:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963076224:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782114.311253:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782114.311329:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963076224:0@lo:400:kworker.0 00010000:00080000:0.0:1787782114.311341:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993d67fd8f00 x1874624963076864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782114.311350:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963076864:0@lo:400:kworker.0 00000100:00100000:0.0:1787782114.311377:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963076480:0@lo:400:kworker.0 00010000:00080000:0.0:1787782114.311387:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993d67fd8b40 x1874624963076352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782114.311396:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963076352:0@lo:400:kworker.0 00000100:00100000:1.0:1787782114.311670:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963076608:0@lo:8:kworker.0 00000400:00000100:1.0:1787782114.311701:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963076608 offset 0 length 520: 4 00000100:00100000:1.0:1787782114.311721:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963076736:0@lo:8:kworker.0 00000400:00000100:1.0:1787782114.311739:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963076736 offset 0 length 520: 4 00000100:00100000:2.0:1787782114.311811:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076096 00000100:00100000:2.0:1787782114.311817:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076096 00000100:00100000:2.0:1787782114.311854:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787782114.311862:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:3659:x1874624963076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782114.311911:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:3659:x1874624963076096:12345-0@lo:400:kworker.0 Request processed in 50us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782114.311925:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782114.312042:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963076096:0@lo:400:kworker.0 00010000:00010000:1.0:1787782114.694424:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782115.014149:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787782115.014156:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d67ccb800 from 13 10000000:01000000:0.0:1787782115.014161:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782115.014202:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782115.014213:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782115.014224:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782115.014273:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963076992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782115.014340:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782115.014384:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c41d050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782115.014441:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963076992 00000100:00100000:1.0:1787782115.014447:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963076992 00000100:00100000:1.0:1787782115.014506:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782115.014515:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+16:17206:x1874624963076992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782115.014528:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782115.014541:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064651 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.014563:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064651 expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.014573:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064651 expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.014582:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb600, rc 0) 00000100:00100000:1.0:1787782115.014650:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963076992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782115.014657:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787782115.014800:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963076992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782115.014815:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782115.014823:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782115.014890:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782115.014918:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782115.014944:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49066840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782115.014996:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077120 00000100:00100000:1.0:1787782115.015000:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077120 00000100:00100000:1.0:1787782115.015032:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782115.015046:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963077120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.015152:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963077120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782115.015160:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782115.015189:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.015217:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.015266:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782115.015286:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782115.015297:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077248 00000100:00100000:1.0:1787782115.015300:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077248 00000100:00100000:1.0:1787782115.015316:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782115.015321:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963077248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.015395:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963077248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782115.015401:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782115.015437:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787782115.023649:0:18442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787782115.024093:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787782115.024123:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782115.024135:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.024147:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782115.024158:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782115.024160:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993c4442b000 from 13 10000000:01000000:1.0:1787782115.024178:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782115.024216:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.024223:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.024234:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782115.024269:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.024333:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782115.024376:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782115.025299:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077376 00000100:00100000:2.0:1787782115.025310:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077376 00000100:00100000:2.0:1787782115.025367:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787782115.025378:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+17:17206:x1874624963077376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782115.025394:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782115.025408:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506465f expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782115.025432:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506465f expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782115.025443:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506465f expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782115.025451:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e5800, rc 0) 00000100:00100000:2.0:1787782115.025969:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963077376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 591us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782115.025978:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782115.026075:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782115.026106:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782115.026116:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782115.026185:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.026220:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782115.026267:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782115.026323:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077504 00000100:00100000:0.0:1787782115.026328:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077504 00000100:00100000:0.0:1787782115.026366:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787782115.026374:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963077504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782115.026503:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963077504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782115.026510:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782115.026832:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.026865:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782115.026911:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782115.026939:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43003000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782115.027130:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077632 00000100:00100000:2.0:1787782115.027135:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077632 00000100:00100000:2.0:1787782115.027170:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787782115.027177:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963077632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782115.027278:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:17206:x1874624963077632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782115.027284:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787782115.027866:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963077632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787782115.029003:0:18443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787782115.029272:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787782115.029303:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782115.029313:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782115.029325:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782115.333758:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782115.333775:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963077760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782115.333852:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782115.333900:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077760 00000100:00100000:0.0:1787782115.333908:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077760 00000100:00100000:0.0:1787782115.333955:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782115.333964:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963077760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787782115.333998:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782115.334088:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963077760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782115.334095:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782115.334172:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963077760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782115.337126:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782115.337154:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963077888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782115.337234:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782115.337542:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963077888 00000100:00100000:1.0:1787782115.337551:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963077888 00000100:00100000:1.0:1787782115.337602:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787782115.337642:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963077888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787782115.337678:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787782115.339084:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874624963077888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1437us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782115.339096:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782115.339231:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963077888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787782115.719545:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787782115.848858:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1787782116.102303:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787782116.359145:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782101/real 1787782101] req@ffff993c43e43c00 x1874624963068928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782116.359190:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c43e43c00 x1874624963068928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782116.359201:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782101/real 1787782101] req@ffff993c43e40780 x1874624963069056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782116.359216:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c43e40780 x1874624963069056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782116.359248:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782116.359268:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782116.359272:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963068928:0@lo:8:kworker.0 00000100:00080000:0.0:1787782116.359279:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782116.359286:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782116.359290:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963069056:0@lo:8:kworker.0 00000100:00080000:0.0:1787782116.359381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782116.359385:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787782116.359387:0:8:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782116.359393:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1787782116.359405:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782116.359412:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff993d67b7f800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782116.359432:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a7c00 x1874624963078272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782116.359449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782116.359452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787782116.359460:0:8:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782116.359464:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1787782116.359467:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787782116.359471:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff993d67b78800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782116.359486:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c431a6d00 x1874624963078400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782116.359515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782116.359518:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782116.359521:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782116.359589:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782116.359691:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963078016:0@lo:400:kworker.0 00000100:00100000:1.0:1787782116.359772:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963078144:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.359798:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782116.359813:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782116.359849:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963078784:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.359882:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782116.359908:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782116.359915:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963078656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.359940:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782116.359970:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963078528:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.359994:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782116.360022:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078016 00000100:00100000:0.0:1787782116.360028:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078016 00000100:00100000:0.0:1787782116.360074:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787782116.360084:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3658:x1874624963078016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.360136:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:3658:x1874624963078016:12345-0@lo:400:kworker.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.360150:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787782116.360189:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078784 00000100:00100000:0.0:1787782116.360194:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078784 00000100:00100000:0.0:1787782116.360222:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078528 00000100:00100000:0.0:1787782116.360225:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078528 00000100:00100000:0.0:1787782116.362217:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782116.362243:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963078784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.362328:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963078784:12345-0@lo:400:kworker.0 Request processed in 100us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.362336:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782116.362353:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782116.362359:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.362399:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963078528:12345-0@lo:400:kworker.0 Request processed in 40us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.362405:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782116.362433:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078144 00000100:00100000:0.0:1787782116.362440:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078144 00000100:00100000:0.0:1787782116.362467:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078656 00000100:00100000:0.0:1787782116.362470:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078656 00000100:00100000:0.0:1787782116.362482:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782116.362487:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963078144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.363397:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963078144:12345-0@lo:400:kworker.0 Request processed in 902us (3579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.363409:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782116.363436:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782116.363446:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963078656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.363535:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963078656:12345-0@lo:400:kworker.0 Request processed in 92us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.363541:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787782116.363596:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43edd680 x1874624963078528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782116.363626:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963078528:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.363661:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963078272:0@lo:8:kworker.0 00000400:00000100:0.0:1787782116.363689:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963078272 offset 0 length 520: 4 00000100:00100000:0.0:1787782116.363707:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963078400:0@lo:8:kworker.0 00000400:00000100:0.0:1787782116.363728:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874624963078400 offset 0 length 520: 4 00000100:00100000:0.0:1787782116.363761:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963078656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782116.363774:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963078016:0@lo:400:kworker.0 00010000:00080000:0.0:1787782116.363785:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43edc000 x1874624963078784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782116.363794:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963078784:0@lo:400:kworker.0 00000100:00100000:1.0:1787782116.364305:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963078144:0@lo:400:kworker.0 00010000:00010000:1.0:1787782116.745918:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782117.781263:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782118.789899:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782119.637862:0:18711:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782119.637865:0:18711:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787782119.637867:0:18711:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787782119.637995:0:18711:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993d44432000 00000020:01000004:2.0:1787782119.638011:0:18711:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787782119.638024:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787782119.638037:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff993d7adecd28) 00000020:00000080:2.0:1787782119.638053:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787782119.709183:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787782119.709837:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787782119.710474:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787782119.710681:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787782119.710948:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787782119.711198:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787782119.711415:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787782119.715999:0:18711:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787782119.716202:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787782119.716225:0:18711:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782119.716236:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6d6745c15064674 00000020:01000004:2.0:1787782119.716242:0:18711:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787782119.716262:0:18711:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787782119.716266:0:18711:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787782119.716280:0:18711:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787782119.716286:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787782119.716296:0:18711:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff993d7ade8000) 00000020:00000080:2.0:1787782119.716307:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787782119.726357:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782119.730014:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787782119.730021:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787782119.732630:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787782119.732642:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787782119.733383:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787782119.733391:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787782119.735236:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782119.735975:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787782119.735982:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787782119.736596:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787782119.736602:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787782119.762868:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782119.763191:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787782119.763198:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787782119.764866:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787782119.764878:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787782119.769747:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787782119.769835:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787782119.774394:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782119.774592:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787782119.774598:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787782119.775462:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787782119.775470:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787782119.813787:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782119.841047:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782119.841255:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787782119.841262:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787782119.842342:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787782119.842354:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787782119.842851:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787782119.842877:0:18711:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787782119.842883:0:18711:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787782119.853665:0:18711:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787782119.853704:0:18711:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.116@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787782119.853708:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787782119.853710:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787782119.853711:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782119.853712:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782119.853714:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782119.853715:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782119.853716:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782119.853718:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782119.853719:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782119.853723:0:18711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787782119.853730:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782119.853731:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787782119.853732:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782119.853733:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782119.853734:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782119.853735:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782119.853736:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782119.853737:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782119.853738:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782119.853769:0:18711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787782119.853789:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963078912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782119.853865:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.853908:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782119.854094:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963078912 00000100:00100000:2.0:1787782119.854101:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963078912 00000100:00100000:2.0:1787782119.854261:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787782119.854272:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:18711:x1874624963078912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782119.854311:0:17201:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787782119.854314:0:17201:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787782119.854317:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787782119.854964:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:18711:x1874624963078912:12345-0@lo:253:mount.lustre.0 Request processed in 692us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.854973:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787782119.855063:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963078912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787782119.855076:0:18711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787782119.855078:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787782119.855080:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787782119.855082:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782119.855083:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782119.855084:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782119.855085:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782119.855087:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782119.855088:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782119.855090:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787782119.855109:0:18711:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993d44432000 from lustre-OST0000 10000000:01000000:3.0:1787782119.855153:0:18711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787782119.855156:0:18711:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787782119.855163:0:18711:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993c437e0000 local copy 00010000:00010000:3.0:1787782119.855174:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782119.855269:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782119.855302:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.856754:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.856964:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079040 00000100:00100000:1.0:1787782119.856973:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079040 00000100:00100000:1.0:1787782119.857017:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782119.857025:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:18711:x1874624963079040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782119.857137:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:18711:x1874624963079040:12345-0@lo:501:mount.lustre.0 Request processed in 113us (1833us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782119.857144:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782119.857288:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787782119.857306:0:18711:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787782119.857330:0:18711:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787782119.857338:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.857348:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782119.857375:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993d44432000 10000000:01000000:3.0:1787782119.857380:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787782119.857386:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787782119.857389:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782119.857393:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787782119.857395:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787782119.857421:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.857429:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.857437:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782119.857454:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782119.857486:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.857509:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.857555:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079168 00000100:00100000:1.0:1787782119.857560:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079168 00000100:00100000:1.0:1787782119.857577:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782119.857583:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+18:18711:x1874624963079168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782119.857591:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782119.857966:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfb800/0xc6d6745c15064689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064682 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782119.857988:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb800/0xc6d6745c15064689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064682 expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782119.857998:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfb800/0xc6d6745c15064689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064682 expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782119.858006:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb800, rc 0) 00000100:00100000:1.0:1787782119.858044:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079168:12345-0@lo:101:mount.lustre.0 Request processed in 461us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.858060:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787782119.858139:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782119.858152:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064689 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.858168:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064689 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782119.859354:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787782119.860285:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782119.866152:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787782119.866209:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787782119.866241:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787782119.866255:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787782119.866270:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787782119.866282:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787782119.866305:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787782119.866311:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787782119.866415:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782119.866477:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.866525:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.866719:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079296 00000100:00100000:1.0:1787782119.866726:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079296 00000100:00100000:1.0:1787782119.866855:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782119.866865:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782119.867022:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079296:12345-0@lo:501:mount.lustre.0 Request processed in 157us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.867029:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787782119.867156:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782119.867192:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782119.867247:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.867321:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782119.867355:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079424 00000100:00100000:2.0:1787782119.867366:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079424 00000100:00100000:2.0:1787782119.867388:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782119.867394:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782119.868650:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079424:12345-0@lo:503:mount.lustre.0 Request processed in 1249us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.868660:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787782119.868978:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787782119.870122:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782119.870232:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.870437:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.870482:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.870554:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079552 00000100:00100000:0.0:1787782119.870567:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079552 00000100:00100000:0.0:1787782119.870744:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782119.870753:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782119.871436:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079552:12345-0@lo:502:mount.lustre.0 Request processed in 683us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.871446:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787782119.871797:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782119.872039:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787782119.872087:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787782119.872102:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787782119.872112:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787782119.872124:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787782119.872136:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787782119.872148:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787782119.872158:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787782119.872169:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787782119.872181:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787782119.872193:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787782119.872205:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787782119.872248:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.872589:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.872775:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58825300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782119.872887:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079680 00000100:00100000:2.0:1787782119.872894:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079680 00000100:00100000:2.0:1787782119.872944:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787782119.872954:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782119.873197:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079680:12345-0@lo:502:mount.lustre.0 Request processed in 244us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.873205:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787782119.873530:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782119.873600:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787782119.873921:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787782119.875128:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787782119.875138:0:18728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787782119.875145:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.875147:0:18728:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787782119.875154:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787782119.875168:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff993d5ea94d28) 00000020:00000080:0.0:1787782119.875191:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787782119.875198:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787782119.875428:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d44432000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787782119.875438:0:18728:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787782119.875445:0:18728:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6d6745c15064697 00010000:00010000:1.0:1787782119.883139:0:18728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787782119.884169:0:18728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787782119.886654:0:18728:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787782119.888732:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787782119.888744:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782119.888751:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.888954:0:18728:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787782119.888961:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787782119.888964:0:18728:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787782119.888966:0:18728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782119.888967:0:18728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782119.888968:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787782119.888972:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.888974:0:18728:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787782119.888976:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782119.888979:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.888980:0:18728:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787782119.888983:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787782119.888985:0:18728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787782119.888987:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782119.888989:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.888990:0:18728:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787782119.888993:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782119.888995:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.888996:0:18728:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787782119.888999:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787782119.889036:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782119.889040:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782119.889041:0:18728:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787782119.889045:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787782119.890236:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787782119.890342:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787782119.890410:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064689 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.890422:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704400/0xc6d6745c15064682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064689 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782119.890431:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d44432000 from 1 10000000:01000000:2.0:1787782119.890433:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782119.890468:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.890475:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.890498:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782119.890520:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782119.890582:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.890648:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d46578a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.890769:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079808 00000100:00100000:0.0:1787782119.890776:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079808 00000100:00100000:0.0:1787782119.890825:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787782119.890835:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:18711:x1874624963079808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782119.890847:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782119.890860:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506469e expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.890882:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506469e expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.890892:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506469e expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.890913:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8000, rc 0) 00000100:00100000:0.0:1787782119.890952:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963079808:12345-0@lo:101:mount.lustre.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.890960:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787782119.891228:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782119.891242:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.891250:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782119.892633:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787782119.893013:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782119.893540:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787782119.893569:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787782119.893589:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787782119.893596:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787782119.894746:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782119.895001:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.896083:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d465786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.904039:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963079936 00000100:00100000:0.0:1787782119.904051:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963079936 00000100:00100000:0.0:1787782119.904111:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782119.904121:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963079936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782119.904299:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963079936:12345-0@lo:501:mount.lustre.0 Request processed in 179us (9298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.904307:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782119.907911:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963079936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782119.907982:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782119.908087:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.908135:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d591e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782119.908281:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080064 00000100:00100000:3.0:1787782119.908288:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080064 00000100:00100000:3.0:1787782119.908338:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787782119.908348:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782119.908465:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080064:12345-0@lo:503:mount.lustre.0 Request processed in 118us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782119.908473:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782119.908654:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787782119.909519:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787782119.909597:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782119.909686:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.909719:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d799a3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.909988:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080192 00000100:00100000:0.0:1787782119.909995:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080192 00000100:00100000:0.0:1787782119.910046:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787782119.910055:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782119.910150:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080192:12345-0@lo:502:mount.lustre.0 Request processed in 96us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.910158:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782119.912242:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782119.912505:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787782119.912540:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787782119.912554:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787782119.912567:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787782119.912579:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787782119.912591:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787782119.912629:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787782119.912657:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787782119.912670:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787782119.912682:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787782119.912694:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787782119.912742:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782119.913003:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.913100:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.916345:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080320 00000100:00100000:0.0:1787782119.916358:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080320 00000100:00100000:2.0:1787782119.916577:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787782119.916586:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782119.916969:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782119.917049:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787782119.917061:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:2.0:1787782119.917594:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080320:12345-0@lo:502:mount.lustre.0 Request processed in 1006us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.917639:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:01000000:0.0:1787782119.917972:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782119.917980:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.917982:0:18732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787782119.917989:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d44432000 00000020:00000080:0.0:1787782119.917992:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782119.917998:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782119.918000:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918002:0:18732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787782119.918004:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782119.918006:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918007:0:18732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787782119.918010:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993d44432000 00000020:00000080:0.0:1787782119.918012:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782119.918117:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782119.918120:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918121:0:18732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787782119.918123:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782119.918125:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918127:0:18732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787782119.918130:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d44432000 00000020:00000080:0.0:1787782119.918132:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782119.918147:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782119.918149:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918150:0:18732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787782119.918152:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782119.918154:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918156:0:18732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787782119.918159:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993d44432000 00000020:00000080:0.0:1787782119.918160:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782119.918177:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782119.918179:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782119.918180:0:18732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787782119.918189:0:18732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787782119.919946:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787782119.919990:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782119.920015:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.920042:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782119.920103:0:18711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787782119.920106:0:18711:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993d44432000 10000000:01000000:3.0:1787782119.920109:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993d44432000 10000000:01000000:3.0:1787782119.920113:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782119.920119:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993d44432000 from 1 10000000:01000000:3.0:1787782119.920121:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787782119.920157:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.920165:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.920188:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782119.920222:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782119.920293:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.920334:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d45433c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.921909:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080448 00000100:00100000:0.0:1787782119.921920:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080448 00000100:00100000:0.0:1787782119.921974:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787782119.921983:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:18711:x1874624963080448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782119.921997:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782119.922013:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9600/0xc6d6745c150646b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150646ac expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.922052:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9600/0xc6d6745c150646b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150646ac expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.922064:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9600/0xc6d6745c150646b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150646ac expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.922073:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9600, rc 0) 00000100:00100000:0.0:1787782119.922133:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080448:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.922140:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787782119.923043:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782119.923066:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646b3 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782119.923076:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150646b3 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782119.925230:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787782119.925501:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782119.925696:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787782119.925722:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787782119.925737:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787782119.925752:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787782119.926709:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787782119.926737:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787782119.927098:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787782119.927139:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787782119.927156:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787782119.927167:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787782119.927709:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787782119.927728:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787782119.927740:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787782119.927752:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787782119.930243:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787782119.930264:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787782119.930279:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787782119.930292:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787782119.930304:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787782119.930318:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787782119.930331:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787782119.930342:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787782119.930354:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787782119.930388:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787782119.930406:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787782119.930421:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787782119.930434:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787782119.930446:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787782119.930458:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787782119.930472:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787782119.930485:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787782119.930499:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787782119.930514:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787782119.930526:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787782119.930540:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787782119.930553:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787782119.930564:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787782119.930589:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787782119.930595:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787782119.930724:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782119.933912:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.933959:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.934879:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080576 00000100:00100000:0.0:1787782119.934891:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080576 00000100:00100000:0.0:1787782119.934941:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787782119.934951:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782119.935131:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080576:12345-0@lo:501:mount.lustre.0 Request processed in 181us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.935139:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787782119.935488:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782119.935541:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782119.935604:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782119.935648:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.935891:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080704 00000100:00100000:1.0:1787782119.935896:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080704 00000100:00100000:1.0:1787782119.935931:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787782119.935947:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782119.937007:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080704:12345-0@lo:503:mount.lustre.0 Request processed in 1056us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.937019:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787782119.938038:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782119.938463:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782119.938564:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782119.938654:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.938694:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d591e4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.939159:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080832 00000100:00100000:1.0:1787782119.939167:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080832 00000100:00100000:1.0:1787782119.939233:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787782119.939242:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.939355:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080832:12345-0@lo:502:mount.lustre.0 Request processed in 114us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.939362:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787782119.940338:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782119.940599:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787782119.940647:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787782119.940663:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787782119.940677:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787782119.940689:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787782119.940700:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787782119.940711:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787782119.940724:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787782119.940735:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787782119.940747:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787782119.940760:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787782119.942398:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787782119.942415:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787782119.942428:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787782119.942446:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787782119.942463:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787782119.942492:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787782119.942510:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787782119.942524:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787782119.942537:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787782119.942551:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787782119.942564:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787782119.942576:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787782119.942590:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787782119.943334:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787782119.943379:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787782119.943396:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787782119.943423:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787782119.943437:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787782119.943452:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787782119.943465:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787782119.943477:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787782119.943505:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787782119.943523:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787782119.943537:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787782119.943551:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787782119.943565:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787782119.943579:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787782119.943592:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787782119.944867:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787782119.944904:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787782119.944919:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787782119.944933:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787782119.944947:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787782119.944961:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787782119.944973:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787782119.944988:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787782119.945003:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787782119.945556:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782119.946834:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.946880:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d591e49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782119.948222:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963080960 00000100:00100000:1.0:1787782119.948236:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963080960 00000100:00100000:1.0:1787782119.948294:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787782119.948305:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.954152:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963080960:12345-0@lo:502:mount.lustre.0 Request processed in 5839us (7311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.954167:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787782119.954452:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963080960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782119.955431:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787782119.955470:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787782119.955512:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963081088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.955579:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.958869:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43042540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782119.959161:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081088 00000100:00100000:2.0:1787782119.959171:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081088 00000100:00100000:1.0:1787782119.959358:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787782119.959368:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963081088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782119.959510:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963081088:12345-0@lo:502:mount.lustre.0 Request processed in 143us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.959518:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787782119.959574:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963081088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782119.959662:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787782119.959676:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787782119.963474:0:18737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787782119.963996:0:18737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff993d588099b8) 00000020:00000080:1.0:1787782119.964021:0:18737:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787782119.964186:0:18737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d44432000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787782119.964190:0:18737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d44432000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787782119.964193:0:18737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d44432000 3 00010000:00080000:1.0:1787782119.964234:0:18737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993d770b4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.116@tcp at head 00010000:00010000:0.0:1787782119.970490:0:18737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787782119.973243:0:18737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787782119.973302:0:18737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787782119.973314:0:18737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6d6745c150646c1 00000100:00080000:0.0:1787782119.973325:0:18737:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787782119.973331:0:18737:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff993d770b4000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782119.973364:0:18737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43edd680 x1874624963081216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782119.973428:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963081216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782119.973493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.973556:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081216 00000100:00100000:0.0:1787782119.973562:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081216 00000100:00100000:0.0:1787782119.973590:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782119.973597:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1874624963081216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787782119.973677:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1787782119.973707:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6d6745c150646c8 00000004:00100000:0.0:1787782119.973720:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787782119.973748:0:17211:0:(import.c:65:import_set_state_nolock()) ffff993d44598800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782119.973806:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874624963081216:12345-0@lo:38:llog_process_th.0 Request processed in 208us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.973814:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787782119.973851:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43edd680 x1874624963081216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782119.973861:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782119.973867:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787782119.973873:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787782119.973877:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782119.973879:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d770b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782119.973884:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1874624963081216:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787782119.973903:0:18737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787782119.974352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.974356:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.974358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.974361:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.974382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.974386:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.974388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.974391:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782119.974429:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963081344:0@lo:400:kworker.0 00000100:00100000:1.0:1787782119.974466:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.974494:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782119.974500:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963081472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782119.974527:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.974554:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963081600:0@lo:400:kworker.0 00000100:00100000:1.0:1787782119.974579:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.974598:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782119.974604:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963081728:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.974643:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081344 00000100:00100000:2.0:1787782119.974650:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081344 00000100:00100000:1.0:1787782119.974656:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.974686:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081600 00000100:00100000:2.0:1787782119.974689:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081600 00000100:00100000:1.0:1787782119.974696:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787782119.974708:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963081344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.974712:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782119.974723:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963081600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.974779:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963081600:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.974787:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782119.975221:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963081344:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.975230:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787782119.975280:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963081344:0@lo:400:kworker.0 00000100:00100000:1.0:1787782119.975308:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963081600:0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.976459:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081472 00000100:00100000:0.0:1787782119.976472:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081472 00000100:00100000:0.0:1787782119.976530:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081728 00000100:00100000:0.0:1787782119.976534:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081728 00000100:00100000:0.0:1787782119.976552:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782119.976559:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963081472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.976656:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963081472:12345-0@lo:400:kworker.0 Request processed in 97us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.976664:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782119.976679:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782119.976685:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963081728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.976718:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874624963081728:12345-0@lo:400:kworker.0 Request processed in 34us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.976725:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787782119.976759:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43e412c0 x1874624963081472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782119.977104:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963081472:0@lo:400:kworker.0 00010000:00080000:0.0:1787782119.977142:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43e41680 x1874624963081728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782119.977151:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874624963081728:0@lo:400:kworker.0 00000020:01000004:1.0:1787782119.977999:0:18737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787782119.978014:0:18737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff993d58808000) 00000020:00000080:1.0:1787782119.978101:0:18737:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787782119.978205:0:18737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993d44432000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787782119.978210:0:18737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993d44432000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787782119.978223:0:18737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993d44432000 3 00010000:00080000:1.0:1787782119.978456:0:18737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c4448d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.116@tcp at head 00010000:00010000:1.0:1787782119.982643:0:18737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787782119.987989:0:18737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787782119.989652:0:18737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787782119.989669:0:18737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc6d6745c150646d6 00000100:00080000:1.0:1787782119.989681:0:18737:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782119.989700:0:18737:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff993c4448d000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782119.989735:0:18737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43e43840 x1874624963081856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782119.989759:0:18737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787782119.989794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.989799:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.989801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.989805:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.989808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.989811:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782119.989813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782119.989817:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782119.990192:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624963081856:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787782119.990335:0:18737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787782119.990535:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787782119.990563:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782119.990578:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646b3 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.990589:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704000/0xc6d6745c150646ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646b3 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787782119.990656:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787782119.990658:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782119.990660:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782119.990661:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782119.990662:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782119.990664:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782119.990665:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782119.990667:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782119.990668:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782119.990671:0:18711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787782119.990674:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782119.990680:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782119.990681:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782119.990682:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782119.990683:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782119.990684:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782119.990685:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782119.990686:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782119.990686:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782119.990705:0:18711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787782119.990719:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963081984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782119.990785:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.990824:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d58a2ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.991201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782119.991724:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081984 00000100:00100000:1.0:1787782119.991731:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081984 00000100:00100000:0.0:1787782119.991887:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963081856 00000100:00100000:0.0:1787782119.991891:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963081856 00000100:00100000:0.0:1787782119.991922:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782119.991930:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1874624963081856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787782119.991959:0:17210:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1787782119.992004:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc6d6745c150646dd 00000004:00100000:0.0:1787782119.992018:0:17210:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787782119.992114:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787782119.992122:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963081984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782119.992144:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787782119.992156:0:17204:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1787782119.992959:0:17210:0:(import.c:65:import_set_state_nolock()) ffff993d4459e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782119.994158:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874624963081856:12345-0@lo:38:llog_process_th.0 Request processed in 2222us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.994171:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787782119.994343:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff993c43e43840 x1874624963081856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782119.994356:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782119.994367:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787782119.994376:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787782119.994390:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787782119.994394:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c4448d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787782119.994402:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1874624963081856:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787782119.997445:0:17204:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787782119.997460:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787782119.997554:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787782119.997559:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787782119.997579:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997596:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064627 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997603:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064635 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997635:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997672:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997687:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 21 pid: 17201 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782119.997702:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963082112:0@lo:104: 00000100:00100000:0.0:1787782119.997768:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787782119.997837:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.997846:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 21 pid: 17203 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782119.997855:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963082240:0@lo:104: 00000100:00100000:0.0:1787782119.997881:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.997897:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d591e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782119.997921:0:17192:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787782119.997935:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082112 00000100:00100000:0.0:1787782119.997941:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082112 00000100:00100000:0.0:1787782119.997970:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082240 00000100:00100000:0.0:1787782119.997974:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082240 00000100:00100000:0.0:1787782119.997988:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782119.997996:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963082112:12345-0@lo:104: 00010000:00010000:0.0:1787782119.998008:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782120.000761:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:18711:x1874624963081984:12345-0@lo:253:mount.lustre.0 Request processed in 8622us (9957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782120.000782:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787782120.000848:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:18711:1874624963081984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782120.000863:0:18711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787782120.000866:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782120.000868:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782120.000869:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782120.000870:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782120.000872:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782120.000873:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782120.000874:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782120.000876:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782120.000877:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782120.000891:0:18711:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787782120.001256:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787782120.001264:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963082112:12345-0@lo:104: Request processed in 3268us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.001272:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782120.001293:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782120.001303:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7c415850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963082240:12345-0@lo:104: 00010000:00010000:0.0:1787782120.001317:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001358:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787782120.001372:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7c415850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963082240:12345-0@lo:104: Request processed in 72us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.001378:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787782120.001414:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782120.001420:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001427:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82167000 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782120.001430:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001439:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782120.001445:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782120.001450:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782120.001481:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001487:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782120.001505:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001511:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82167000/0xc6d6745c15064635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506463c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001522:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782120.001525:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001542:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782120.001545:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001551:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782120.001557:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782120.001562:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782120.001575:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001580:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782120.001586:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001591:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d82166a00/0xc6d6745c15064627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506462e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001604:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782120.001624:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782120.001626:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782120.001632:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782120.001650:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963082368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782120.001684:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782120.001721:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782120.001726:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963082496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782120.001773:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782120.001812:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082368 00000100:00100000:0.0:1787782120.001817:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082368 00010000:00010000:0.0:1787782120.001837:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 21 pid: 17201 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782120.001857:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082496 00000100:00100000:0.0:1787782120.001860:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082496 00010000:00010000:0.0:1787782120.001870:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 22 pid: 17203 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782120.001882:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782120.001888:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3659:x1874624963082368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782120.001897:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782120.001902:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 22 pid: 17201 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001912:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 22 pid: 17201 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.001928:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782120.001956:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3659:x1874624963082368:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.001962:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782120.001976:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782120.001982:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c436f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963082496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782120.001989:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782120.001992:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 21 pid: 17203 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.002009:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 21 pid: 17203 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.002020:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004566:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787782120.004588:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007029394s 00010000:00010000:0.0:1787782120.004593:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004600:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004631:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004639:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004645:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782120.004648:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004656:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004668:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.004685:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782120.004749:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c436f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963082496:12345-0@lo:103:ldlm_bl.0 Request processed in 2765us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.005701:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782120.006322:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963082496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782120.006333:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963082368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782120.006363:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e4c00/0xc6d6745c1506463c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15064635 expref: 20 pid: 17201 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782120.006377:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963082112:0@lo:104: 00010000:00010000:0.0:1787782120.006386:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43705400/0xc6d6745c1506462e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15064627 expref: 19 pid: 17203 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782120.006394:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963082240:0@lo:104: 00010000:00010000:0.0:1787782120.006407:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.006416:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.006422:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.006428:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8200/0xc6d6745c150646e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787782120.007225:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787782120.010540:0:18711:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787782120.010550:0:18711:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787782120.010582:0:18711:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787782120.010659:0:18711:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787782120.010676:0:18711:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787782120.010694:0:18711:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787782120.011803:0:18711:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787782120.012021:0:18711:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787782120.454086:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963082624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787782120.454154:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782120.454226:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782120.454232:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963082752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782120.454257:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.454283:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082624 00000100:00100000:3.0:1787782120.454291:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082624 00000100:00100000:3.0:1787782120.454342:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082752 00000100:00100000:3.0:1787782120.454345:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082752 00000100:00100000:3.0:1787782120.454362:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782120.454370:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963082624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787782120.454401:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787782120.454461:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963082624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782120.454468:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782120.454486:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782120.454493:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963082752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787782120.454514:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782120.454543:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963082752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782120.454549:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782120.454586:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963082752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782120.454602:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963082624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787782120.838774:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787782120.976872:0:18790:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787782120.977243:0:18790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787782121.733695:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782121.733704:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d67ccb800 from 9 10000000:01000000:0.0:1787782121.733709:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782121.733755:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782121.733767:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782121.733777:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782121.733801:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963082880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782121.733866:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782121.733959:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d591e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782121.735307:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963082880 00000100:00100000:2.0:1787782121.735320:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963082880 00000100:00100000:2.0:1787782121.735554:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787782121.735564:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+19:17206:x1874624963082880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782121.735581:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782121.735600:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150646eb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.735642:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150646eb expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.735653:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150646eb expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.735662:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4e00, rc 0) 00000100:00100000:2.0:1787782121.735733:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:17206:x1874624963082880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.735739:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787782121.735799:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963082880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782121.735817:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.735827:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782121.735887:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787782121.735929:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782121.735948:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d723c5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782121.735961:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083008 00000100:00100000:2.0:1787782121.735965:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083008 00000100:00100000:2.0:1787782121.735987:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787782121.735993:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:17206:x1874624963083008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787782121.736004:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787782121.736019:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787782121.736022:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787782121.736095:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:17206:x1874624963083008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.736101:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787782121.736124:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787782121.736176:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787782121.736525:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.736534:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782121.736543:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787782121.736545:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993c4442b000 from 9 10000000:01000000:2.0:1787782121.736548:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787782121.736568:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.736575:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.736593:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782121.737296:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782121.737548:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782121.737653:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782121.740540:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083136 00000100:00100000:0.0:1787782121.740555:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083136 00000100:00100000:0.0:1787782121.740676:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787782121.740688:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:17206:x1874624963083136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782121.740705:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782121.740724:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150646f9 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782121.740752:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782121.740763:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782121.740772:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8600, rc 0) 00000100:00100000:0.0:1787782121.740857:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963083136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782121.740864:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787782121.744249:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782121.744275:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.744289:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782121.744823:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787782121.744887:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782121.744932:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77238a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782121.745011:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083264 00000100:00100000:3.0:1787782121.745017:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083264 00000100:00100000:3.0:1787782121.745063:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787782121.745071:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963083264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787782121.745089:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787782121.745105:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787782121.745112:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787782121.745212:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963083264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782121.745221:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787782121.745694:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963083264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787782121.745759:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787782121.745769:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782121.745779:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782121.863524:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782122.504686:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782122.885830:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782123.922810:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782124.940933:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782125.061840:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782125.061847:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782125.061849:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782125.061853:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782125.061882:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782125.061885:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782125.061888:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782125.061890:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782125.061936:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963083520:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062004:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062045:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963084032:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062076:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062100:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787782125.062118:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963083392:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062146:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062168:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963083904:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062227:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083520 00000100:00100000:2.0:1787782125.062231:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963083648:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062233:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083520 00000100:00100000:2.0:1787782125.062264:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062271:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782125.062279:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963083520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782125.062282:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963084160:0@lo:400:kworker.0 00000100:00100000:2.0:1787782125.062301:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782125.062313:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782125.062318:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963083776:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062324:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963083520:12345-0@lo:400:kworker.0 Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.062331:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782125.062336:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.062347:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083776 00000100:00100000:1.0:1787782125.062350:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083776 00000100:00100000:1.0:1787782125.062363:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782125.062369:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963083776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782125.062373:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084032 00000100:00100000:2.0:1787782125.062376:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084032 00000100:00100000:1.0:1787782125.062399:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963083776:12345-0@lo:400:kworker.0 Request processed in 30us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782125.062405:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083904 00000100:00100000:1.0:1787782125.062405:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782125.062408:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083904 00000100:00100000:2.0:1787782125.062417:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083648 00000100:00100000:2.0:1787782125.062419:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083648 00000100:00100000:1.0:1787782125.062425:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084160 00000100:00100000:1.0:1787782125.062428:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084160 00000100:00100000:2.0:1787782125.062430:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782125.062435:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963084032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062440:0:17209:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787782125.062447:0:17209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787782125.062462:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963083392 00000100:00100000:1.0:1787782125.062466:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963083392 00000100:00100000:2.0:1787782125.062478:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963084032:12345-0@lo:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782125.062484:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787782125.062487:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787782125.062493:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3660:x1874624963083392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062539:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3660:x1874624963083392:12345-0@lo:400:kworker.0 Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.062555:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787782125.062584:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782125.062590:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963083904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062648:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963083904:12345-0@lo:400:kworker.0 Request processed in 56us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.062653:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782125.062667:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782125.062671:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062695:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963083648:12345-0@lo:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.062699:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782125.062710:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787782125.062715:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062738:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963084160:12345-0@lo:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.062744:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787782125.062849:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963083392:0@lo:400:kworker.0 00010000:00080000:1.0:1787782125.062864:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe0f00 x1874624963083904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782125.062875:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963083904:0@lo:400:kworker.0 00000100:00100000:1.0:1787782125.062885:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963083520:0@lo:400:kworker.0 00010000:00080000:1.0:1787782125.062895:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe2d00 x1874624963084032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782125.062909:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787782125.062913:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782125.062915:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963084032:0@lo:400:kworker.0 00000100:00100000:2.0:1787782125.063079:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963083776:0@lo:400:kworker.0 00010000:00080000:2.0:1787782125.063095:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43e41680 x1874624963083648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782125.063103:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963083648:0@lo:400:kworker.0 00010000:00080000:2.0:1787782125.063112:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe12c0 x1874624963084160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782125.063119:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963084160:0@lo:400:kworker.0 00000100:00100000:2.0:1787782125.576643:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963084288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787782125.576714:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.576814:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963084416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782125.576849:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782125.576894:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084288 00000100:00100000:1.0:1787782125.576900:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084288 00000100:00100000:1.0:1787782125.576938:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084416 00000100:00100000:1.0:1787782125.576942:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084416 00000100:00100000:1.0:1787782125.576956:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782125.576963:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963084288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787782125.576996:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787782125.577109:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963084288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.577116:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782125.577133:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782125.577139:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963084416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787782125.577156:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787782125.577199:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963084416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782125.577205:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782125.577243:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963084416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787782125.578273:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963084288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787782125.957721:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782126.342569:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1787782126.608452:0:19080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782126.982070:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787782127.590421:0:19133:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787782127.590649:0:19133:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787782128.005841:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787782128.509473:0:19183:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787782128.510350:0:19183:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787782129.030734:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782129.224811:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782114/real 1787782114] req@ffff993d67fd9680 x1874624963076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.225058:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993d67fd9680 x1874624963076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.225069:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782114/real 1787782114] req@ffff993d67fdb480 x1874624963076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.225079:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993d67fdb480 x1874624963076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782129.225097:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d487d1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782129.225119:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782129.225123:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963076608:0@lo:8:kworker.0 00000100:00080000:0.0:1787782129.225128:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782129.225133:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782129.225135:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963076736:0@lo:8:kworker.0 00000100:00080000:1.0:1787782129.225302:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782129.225306:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782129.225315:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782129.225318:0:14356:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782129.225336:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782129.225338:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787782129.225341:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d487d1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782129.225346:0:14356:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1787782129.225350:0:14356:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787782129.225357:0:14356:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff993d487d1800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782129.225375:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43fe03c0 x1874624963085056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782129.225670:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963084672:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.225798:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.225854:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782129.225869:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963084800:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.225897:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.225925:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963084928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.225947:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.225965:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782129.225971:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963084544:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.225998:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.226032:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084672 00000100:00100000:0.0:1787782129.226038:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084672 00000100:00100000:0.0:1787782129.226070:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084928 00000100:00100000:0.0:1787782129.226073:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084928 00000100:00100000:0.0:1787782129.226089:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782129.226097:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.226143:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963084672:12345-0@lo:400:kworker.0 Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782129.226150:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782129.226183:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782129.226190:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963084928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.226233:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963084928:12345-0@lo:400:kworker.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782129.226239:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782129.226256:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084544 00000100:00100000:0.0:1787782129.226260:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084544 00000100:00100000:0.0:1787782129.226282:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787782129.226288:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.226314:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963084544:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00080000:1.0:1787782129.226390:0:14356:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782129.226394:0:14356:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782129.226397:0:14356:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782129.226401:0:14356:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1787782129.226404:0:14356:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787782129.226408:0:14356:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:1.0:1787782129.226427:0:14356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993c43fe2940 x1874624963085184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782129.226465:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963085568:0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.226492:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782129.226512:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782129.226517:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963085440:0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.226537:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782129.226563:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963084800 00000100:00100000:1.0:1787782129.226572:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963084800 00000100:00100000:1.0:1787782129.226598:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085568 00000100:00100000:1.0:1787782129.226601:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085568 00000100:00100000:1.0:1787782129.226638:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085440 00000100:00100000:1.0:1787782129.226640:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085440 00000100:00100000:1.0:1787782129.226655:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782129.226660:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963084800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.226691:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963084800:12345-0@lo:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782129.226698:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782129.226710:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782129.226716:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.226746:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963085568:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782129.226751:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782129.226761:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782129.226767:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.226792:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963085440:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782129.226797:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787782129.226821:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782129.226824:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787782129.226858:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe1e00 x1874624963085440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782129.226869:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963085440:0@lo:400:kworker.0 00010000:00080000:1.0:1787782129.226879:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe30c0 x1874624963085568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782129.226898:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963085568:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.227151:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787782129.227241:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963085312:0@lo:400:kworker.0 00000100:00100000:3.0:1787782129.227272:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.227291:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963084544:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.227302:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963084928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.227393:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963085056:0@lo:8:kworker.0 00000100:00100000:0.0:1787782129.227421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.227456:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963085184:0@lo:8:kworker.0 00000100:00100000:0.0:1787782129.227481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787782129.227513:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe0b40 x1874624963084800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.227522:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963084800:0@lo:400:kworker.0 00000100:00100000:0.0:1787782129.227532:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963084672:0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.228146:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085312 00000100:00100000:1.0:1787782129.228154:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085312 00000100:00100000:1.0:1787782129.228666:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782129.228681:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963085312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.229223:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963085312:12345-0@lo:400:kworker.0 Request processed in 544us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782129.229232:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782129.229265:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085056 00000100:00100000:1.0:1787782129.229265:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085184 00000100:00100000:3.0:1787782129.229269:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085056 00000100:00100000:1.0:1787782129.229269:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085184 00000100:00100000:1.0:1787782129.229288:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782129.229293:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3656:x1874624963085184:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787782129.229314:0:18717:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787782129.236142:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe3480 x1874624963085312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.236159:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963085312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782129.250218:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3656:x1874624963085184:12345-0@lo:8:kworker.0 Request processed in 20917us (22728us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782129.250232:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782129.250263:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782129.250269:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3656:x1874624963085056:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787782129.250296:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1787782129.250332:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15064707 00002000:00100000:1.0:1787782129.250347:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff993d77c1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787782129.250351:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787782129.250353:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787782129.250507:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787782129.250537:0:18717:0:(import.c:65:import_set_state_nolock()) ffff993d77c1d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782129.250590:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624963085056:12345-0@lo:8:kworker.0 Request processed in 319us (23167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782129.250596:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782129.251011:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe03c0 x1874624963085056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782129.251022:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782129.251029:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787782129.251036:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787782129.251041:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787782129.251044:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d487d1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787782129.251053:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787782129.251065:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963085056:0@lo:8:kworker.0 00000004:00080000:3.0:1787782129.251075:0:17951:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1787782129.251079:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782129.251084:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787782129.251086:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963085184:0@lo:8:kworker.0 00000004:00080000:3.0:1787782129.251135:0:17951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 566332526637ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787782129.251141:0:17951:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1787782129.251646:0:17952:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787782129.251671:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963085824:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787782129.251711:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782129.251765:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963085696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782129.251793:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782129.252010:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304b840 going to sleep for 11 seconds 00000004:00080000:0.0:1787782129.253524:0:17942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787782129.253891:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085824 00000100:00100000:0.0:1787782129.253901:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085824 00000100:00100000:0.0:1787782129.253972:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782129.253983:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17952:x1874624963085824:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1787782129.254184:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787782129.255791:0:18716:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787782129.255798:0:18716:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787782129.255887:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17952:x1874624963085824:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1904us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782129.255897:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787782129.256309:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe1e00 x1874624963085824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787782145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782129.256333:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963085824:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787782129.256345:0:17952:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787782129.256381:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963085952:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787782129.256431:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782129.256463:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c4304b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782129.256849:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085952 00000100:00100000:0.0:1787782129.256856:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085952 00000100:00100000:0.0:1787782129.256904:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782129.256912:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17952:x1874624963085952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787782129.256937:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787782129.256975:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17952:x1874624963085952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782129.256981:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787782129.257083:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe1e00 x1874624963085952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782129.257093:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963085952:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787782129.257102:0:17952:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787782129.257290:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963085696 00000100:00100000:2.0:1787782129.257295:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963085696 00000100:00100000:2.0:1787782129.257449:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782129.257459:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624963085696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787782129.257481:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787782129.257556:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1874624963085696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782129.257563:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782129.257683:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c43fe30c0 x1874624963085696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782129.257699:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963085696:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787782130.053716:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782130.693818:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963086080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782130.693836:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782130.693855:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963086208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782130.695057:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782130.695209:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086208 00000100:00100000:2.0:1787782130.695220:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086208 00000100:00100000:1.0:1787782130.695241:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782130.695285:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086080 00000100:00100000:2.0:1787782130.695289:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086080 00000100:00100000:2.0:1787782130.695311:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787782130.695389:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963086208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787782130.695434:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787782130.695497:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963086208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782130.696150:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787782130.696231:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787782130.696384:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963086208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782130.697388:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963086080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787782130.697660:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787782130.697800:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963086080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1569us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782130.697809:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787782130.698506:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963086080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787782131.079493:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782132.102181:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782132.747041:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787782133.127150:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782134.152988:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782134.280772:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963086336:0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.280851:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787782134.280949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782134.280954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782134.280957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782134.280960:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782134.283769:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963086848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782134.283849:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.283891:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782134.283898:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963086720:0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.283924:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.283968:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086848 00000100:00100000:0.0:1787782134.283976:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086848 00000100:00100000:0.0:1787782134.284031:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782134.284040:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624963086848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787782134.284073:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787782134.284114:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874624963086848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782134.284121:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782134.284157:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086720 00000100:00100000:0.0:1787782134.284161:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086720 00000100:00100000:0.0:1787782134.284191:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782134.284198:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963086720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.284233:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963086720:12345-0@lo:400:kworker.0 Request processed in 36us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782134.284240:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787782134.284257:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782134.284288:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963086720:0@lo:400:kworker.0 00010000:00080000:0.0:1787782134.284300:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fda580 x1874624963086848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782134.284314:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963086848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782134.285724:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963086592:0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.285791:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.285830:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782134.285837:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963086464:0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.285860:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.285899:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086336 00000100:00100000:0.0:1787782134.285906:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086336 00000100:00100000:0.0:1787782134.285944:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787782134.285951:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3658:x1874624963086336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787782134.286025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782134.286030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787782134.286033:0:8:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782134.286038:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787782134.286042:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787782134.286046:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:3.0:1787782134.286073:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d491630c0 x1874624963086976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782134.286146:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086464 00000100:00100000:3.0:1787782134.286150:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086464 00000100:00100000:3.0:1787782134.286177:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782134.286183:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963086464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286216:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963086464:12345-0@lo:400:kworker.0 Request processed in 34us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782134.286222:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782134.286241:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963087104:0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286264:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782134.286281:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782134.286285:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963087232:0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286305:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782134.286327:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086592 00000100:00100000:3.0:1787782134.286330:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086592 00000100:00100000:3.0:1787782134.286349:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087104 00000100:00100000:3.0:1787782134.286351:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087104 00000100:00100000:3.0:1787782134.286359:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087232 00000100:00100000:3.0:1787782134.286361:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087232 00000100:00100000:3.0:1787782134.286381:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782134.286394:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963086592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286423:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963086592:12345-0@lo:400:kworker.0 Request processed in 30us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782134.286429:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782134.286440:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782134.286445:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286473:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874624963087104:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782134.286478:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782134.286489:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782134.286494:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963087232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.286519:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4a563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963087232:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782134.286524:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787782134.288536:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d49162940 x1874624963087232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782134.288556:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963087232:0@lo:400:kworker.0 00010000:00080000:3.0:1787782134.288572:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d49160b40 x1874624963087104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782134.288581:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874624963087104:0@lo:400:kworker.0 00000100:00080000:3.0:1787782134.288627:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782134.288656:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49160780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963086464:0@lo:400:kworker.0 00010000:00080000:3.0:1787782134.288670:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d491621c0 x1874624963086592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782134.288693:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963086592:0@lo:400:kworker.0 00000100:00100000:2.0:1787782134.288841:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963087488:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787782134.288885:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3658:x1874624963086336:12345-0@lo:400:kworker.0 Request processed in 2931us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782134.288896:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787782134.288907:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782134.288944:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782134.288954:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963086976:0@lo:8:kworker.0 00000100:00100000:0.0:1787782134.288979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.289025:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963087360:0@lo:400:kworker.0 00000100:00100000:0.0:1787782134.289051:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.289085:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963086336:0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.289166:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087488 00000100:00100000:3.0:1787782134.289173:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087488 00000100:00100000:3.0:1787782134.289217:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963086976 00000100:00100000:3.0:1787782134.289221:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963086976 00000100:00100000:3.0:1787782134.289233:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782134.289242:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17952:x1874624963087488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787782134.289287:0:18716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787782134.289712:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087360 00000100:00100000:3.0:1787782134.289718:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087360 00000100:00100000:3.0:1787782134.289760:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782134.289767:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963087360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782134.289826:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963087360:12345-0@lo:400:kworker.0 Request processed in 59us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782134.289833:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787782134.289856:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787782134.289882:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d49161680 x1874624963087360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782134.289895:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963087360:0@lo:400:kworker.0 00000001:00080000:0.0:1787782134.319324:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787782134.319343:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787782134.319555:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17952:x1874624963087488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30309us (30642us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787782134.319573:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782134.319604:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782134.319627:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624963086976:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787782134.319648:0:18716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787782134.319789:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd83c0 x1874624963087488/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782150 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782134.319801:0:17952:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787782134.319807:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1874624963087488:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787782134.319820:0:17952:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787782134.319872:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17952:1874624963087616:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787782134.319920:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782134.319944:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782134.319967:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087616 00000100:00100000:0.0:1787782134.319972:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087616 00000100:00100000:0.0:1787782134.320007:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782134.320014:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17952:x1874624963087616:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787782134.320057:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17952:x1874624963087616:12345-0@lo:900:osp-pre-0-1.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782134.320064:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782134.320089:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993c431a4780 x1874624963087616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787782150 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782134.320099:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17952:1874624963087616:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787782134.331360:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624963086976:12345-0@lo:8:kworker.0 Request processed in 11722us (42369us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787782134.331375:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787782134.331448:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782134.331455:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787782134.331459:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963086976:0@lo:8:kworker.0 00000020:01000004:2.0:1787782135.052939:0:19528:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782135.052943:0:19528:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787782135.052944:0:19528:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787782135.053486:0:19528:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff993c410b3800 00000020:01000004:2.0:1787782135.053502:0:19528:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787782135.053516:0:19528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787782135.053539:0:19528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff993c41d6b370) 00000020:00000080:2.0:1787782135.053565:0:19528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787782135.120806:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787782135.122147:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787782135.122581:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787782135.123218:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787782135.123477:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787782135.123793:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787782135.124472:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787782135.129765:0:19528:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787782135.129966:0:19528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787782135.129990:0:19528:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782135.130002:0:19528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6d6745c15064715 00000020:01000004:2.0:1787782135.130008:0:19528:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787782135.130027:0:19528:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787782135.130030:0:19528:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787782135.130037:0:19528:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787782135.130061:0:19528:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787782135.130064:0:19528:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787782135.157829:0:19528:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787782135.157864:0:19528:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787782135.157868:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787782135.157870:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782135.157871:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782135.157872:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782135.157874:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782135.157875:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782135.157876:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782135.157878:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782135.157879:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787782135.157882:0:19528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787782135.157884:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787782135.157886:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782135.157890:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782135.157891:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782135.157892:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782135.157893:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782135.157894:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782135.157895:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782135.157896:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787782135.157924:0:19528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787782135.157941:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963087744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787782135.157998:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.158042:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d497039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.158343:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087744 00000100:00100000:2.0:1787782135.158350:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087744 00000100:00100000:2.0:1787782135.158396:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787782135.158403:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:19528:x1874624963087744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782135.158438:0:17204:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787782135.158441:0:17204:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787782135.158445:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787782135.158915:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:19528:x1874624963087744:12345-0@lo:253:mount.lustre.0 Request processed in 510us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.158923:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787782135.159064:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963087744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787782135.159073:0:19528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787782135.159075:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787782135.159077:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782135.159078:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782135.159079:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782135.159081:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782135.159082:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782135.159083:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782135.159084:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782135.159085:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787782135.159100:0:19528:0:(tgt_mount.c:101:server_register_mount()) register mount ffff993c410b3800 from lustre-OST0001 10000000:01000000:0.0:1787782135.159258:0:19528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787782135.159261:0:19528:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787782135.159268:0:19528:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff993c437e0000 local copy 00010000:00010000:0.0:1787782135.159277:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782135.159359:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963087872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782135.159387:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.159458:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782135.162517:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963087872 00000100:00100000:1.0:1787782135.162530:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963087872 00000100:00100000:1.0:1787782135.162654:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787782135.162665:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:19528:x1874624963087872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782135.162812:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:19528:x1874624963087872:12345-0@lo:501:mount.lustre.0 Request processed in 148us (3423us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782135.162819:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787782135.162908:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963087872:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787782135.162929:0:19528:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787782135.162956:0:19528:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787782135.162964:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.162983:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfa600/0xc6d6745c1506442f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064436 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782135.163012:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff993c410b3800 10000000:01000000:2.0:1787782135.163017:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787782135.163023:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787782135.163025:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782135.163030:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787782135.163033:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787782135.163062:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.163071:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.163092:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782135.163126:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782135.163185:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.173108:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088000 00000100:00100000:0.0:1787782135.173122:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088000 00000100:00100000:0.0:1787782135.173203:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787782135.173212:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:19528:x1874624963088000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782135.173229:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782135.173248:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f9800/0xc6d6745c15064723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506471c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.173277:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f9800/0xc6d6745c15064723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506471c expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.173288:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f9800/0xc6d6745c15064723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506471c expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.173296:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9800, rc 0) 00000100:00100000:0.0:1787782135.173348:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088000:12345-0@lo:101:mount.lustre.0 Request processed in 137us (10163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.173355:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787782135.175670:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782135.175710:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782135.175733:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064723 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.175746:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064723 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782135.178553:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787782135.179821:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1787782135.180974:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782135.182755:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787782135.182808:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787782135.182825:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787782135.182865:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787782135.182879:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787782135.182892:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787782135.182916:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787782135.182922:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787782135.183023:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782135.183086:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.183136:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782135.183323:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088128 00000100:00100000:0.0:1787782135.183397:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088128 00000100:00100000:0.0:1787782135.183451:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787782135.183468:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782135.183649:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088128:12345-0@lo:501:mount.lustre.0 Request processed in 183us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.183657:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787782135.183870:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782135.183903:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782135.183939:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.184010:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c426d5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.185044:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088256 00000100:00100000:2.0:1787782135.185053:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088256 00000100:00100000:2.0:1787782135.185099:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782135.185108:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782135.187714:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088256:12345-0@lo:503:mount.lustre.0 Request processed in 2598us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.187729:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787782135.193069:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782135.195161:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782135.195273:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.195556:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.195647:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088384 00000100:00100000:2.0:1787782135.195654:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088384 00000100:00100000:2.0:1787782135.195709:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787782135.195723:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.195749:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703240 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.196665:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088384:12345-0@lo:502:mount.lustre.0 Request processed in 945us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.196795:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787782135.198072:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782135.199034:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787782135.199075:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787782135.199095:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787782135.199125:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787782135.199154:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787782135.199169:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787782135.199184:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787782135.199198:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787782135.199212:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787782135.199268:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.199340:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.199390:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703240 going to sleep for 11 seconds 00000100:00100000:3.0:1787782135.199599:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088512 00000100:00100000:3.0:1787782135.199756:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088512 00000100:00100000:3.0:1787782135.199817:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787782135.199826:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782135.200060:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088512:12345-0@lo:502:mount.lustre.0 Request processed in 119us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.200069:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787782135.200810:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782135.200883:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787782135.200896:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787782135.204414:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787782135.204426:0:19532:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787782135.204433:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.204436:0:19532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787782135.204444:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782135.204460:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff993d44964d28) 00000020:00000080:3.0:1787782135.204498:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787782135.204519:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782135.204601:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c410b3800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787782135.204653:0:19532:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787782135.204660:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6d6745c15064731 00010000:00010000:3.0:1787782135.212858:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787782135.213440:0:19532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1787782135.215279:0:19532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787782135.219154:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787782135.219165:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782135.219171:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.219173:0:19532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787782135.219176:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782135.219180:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.219182:0:19532:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787782135.219185:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787782135.219187:0:19532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787782135.219189:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782135.219192:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.219193:0:19532:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787782135.219196:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782135.219199:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.219200:0:19532:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787782135.219204:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787782135.219229:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782135.219233:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782135.219234:0:19532:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782135.219238:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787782135.219720:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787782135.219752:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787782135.219771:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064723 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.219784:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e4a00/0xc6d6745c1506471c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064723 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782135.219792:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993c410b3800 from 1 10000000:01000000:2.0:1787782135.219804:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782135.219836:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.219844:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.219855:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782135.219877:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782135.219940:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.219982:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088640 00000100:00100000:2.0:1787782135.219988:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088640 00000100:00100000:2.0:1787782135.220031:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787782135.220039:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:19528:x1874624963088640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782135.220051:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782135.220063:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064738 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.220086:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.220096:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.220104:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4000, rc 0) 00000100:00100000:2.0:1787782135.220147:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963088640:12345-0@lo:101:mount.lustre.0 Request processed in 108us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.220154:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787782135.220200:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.220221:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782135.220233:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.220242:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782135.223884:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787782135.224195:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782135.224400:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787782135.224426:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787782135.224447:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787782135.224454:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787782135.224527:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782135.224593:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.224674:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d773f3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782135.225458:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088768 00000100:00100000:0.0:1787782135.225478:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088768 00000100:00100000:0.0:1787782135.225534:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787782135.225544:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963088768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782135.225715:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963088768:12345-0@lo:501:mount.lustre.0 Request processed in 172us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.225723:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787782135.225775:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782135.225815:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782135.225856:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.225870:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d49703b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.225964:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963088896 00000100:00100000:2.0:1787782135.225978:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963088896 00000100:00100000:2.0:1787782135.226014:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787782135.226022:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963088896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782135.226105:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963088896:12345-0@lo:503:mount.lustre.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.226126:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787782135.226169:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963088896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782135.227411:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782135.227488:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.227547:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.228039:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d503163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782135.229275:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089024 00000100:00100000:1.0:1787782135.229288:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089024 00000100:00100000:1.0:1787782135.229342:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787782135.229352:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963089024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782135.229577:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963089024:12345-0@lo:502:mount.lustre.0 Request processed in 226us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782135.229584:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787782135.229661:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782135.229942:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787782135.229972:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787782135.229988:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787782135.230003:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787782135.230016:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787782135.230028:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787782135.230042:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787782135.230058:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787782135.230095:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787782135.230109:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787782135.230120:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787782135.230163:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.230210:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.230301:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d503163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.230458:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089152 00000100:00100000:2.0:1787782135.230464:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089152 00000100:00100000:2.0:1787782135.230507:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787782135.230515:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963089152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782135.231251:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782135.231252:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963089152:12345-0@lo:502:mount.lustre.0 Request processed in 736us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.231259:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000040:00080000:3.0:1787782135.231312:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787782135.231322:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787782135.232207:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782135.232216:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232223:0:19536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787782135.232229:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993c410b3800 00000020:00000080:1.0:1787782135.232232:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782135.232239:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782135.232241:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232242:0:19536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787782135.232244:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782135.232246:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232248:0:19536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782135.232251:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff993c410b3800 00000020:00000080:1.0:1787782135.232253:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782135.232340:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782135.232345:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232346:0:19536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787782135.232348:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782135.232351:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232352:0:19536:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782135.232356:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993c410b3800 00000020:00000080:1.0:1787782135.232358:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782135.232542:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782135.232546:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232547:0:19536:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782135.232549:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782135.232552:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232553:0:19536:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787782135.232556:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff993c410b3800 00000020:00000080:1.0:1787782135.232557:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782135.232580:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782135.232583:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782135.232584:0:19536:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787782135.232586:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787782135.232800:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787782135.232823:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782135.232846:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782135.232856:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782135.232907:0:19528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787782135.232910:0:19528:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff993c410b3800 10000000:01000000:3.0:1787782135.232912:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff993c410b3800 10000000:01000000:3.0:1787782135.232916:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782135.232921:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff993c410b3800 from 1 10000000:01000000:3.0:1787782135.232924:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787782135.233170:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782135.233180:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782135.233191:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782135.233214:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782135.233268:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.233337:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.233580:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089280 00000100:00100000:2.0:1787782135.233588:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089280 00000100:00100000:2.0:1787782135.233880:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787782135.233890:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:19528:x1874624963089280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782135.233904:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782135.233918:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d412e4800/0xc6d6745c1506474d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064746 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.233941:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d412e4800/0xc6d6745c1506474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064746 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.233963:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d412e4800/0xc6d6745c1506474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064746 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.233972:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d412e4800, rc 0) 00000100:00100000:2.0:1787782135.234024:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089280:12345-0@lo:101:mount.lustre.0 Request processed in 135us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.234030:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787782135.234096:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782135.234110:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506474d expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782135.234119:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c1506474d expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782135.235637:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1787782135.236195:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782135.236385:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787782135.236408:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787782135.236421:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787782135.236435:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787782135.236449:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787782135.236461:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787782135.236475:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787782135.236507:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787782135.236522:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787782135.236535:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787782135.236549:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787782135.236561:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787782135.236571:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787782135.236583:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787782135.236595:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787782135.236632:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787782135.236646:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787782135.236657:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787782135.236667:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787782135.236679:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787782135.236692:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787782135.236704:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787782135.236717:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787782135.236745:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787782135.236761:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787782135.236774:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787782135.236786:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787782135.236796:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787782135.236806:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787782135.236826:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787782135.236838:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787782135.236851:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787782135.236865:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787782135.236878:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787782135.236891:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787782135.236901:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787782135.236912:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787782135.236924:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787782135.236936:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1787782135.238223:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1787782135.238252:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1787782135.238267:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1787782135.238280:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1787782135.238293:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1787782135.238307:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1787782135.238319:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1787782135.238342:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1787782135.238348:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1787782135.239165:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782135.239230:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.239324:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.241063:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089408 00000100:00100000:2.0:1787782135.241076:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089408 00000100:00100000:2.0:1787782135.241141:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787782135.241151:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782135.241309:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089408:12345-0@lo:501:mount.lustre.0 Request processed in 160us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.241325:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787782135.241817:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782135.241859:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782135.241900:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.241922:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.243810:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089536 00000100:00100000:2.0:1787782135.243823:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089536 00000100:00100000:2.0:1787782135.243865:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787782135.243874:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782135.244039:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089536:12345-0@lo:503:mount.lustre.0 Request processed in 166us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.244047:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787782135.246428:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787782135.247300:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787782135.247834:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782135.247907:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.248034:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089664 00000100:00100000:2.0:1787782135.248040:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089664 00000100:00100000:2.0:1787782135.248075:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787782135.248082:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782135.248158:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782135.248299:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089664:12345-0@lo:502:mount.lustre.0 Request processed in 217us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.248307:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787782135.248396:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782135.248911:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787782135.248941:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787782135.250125:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787782135.250161:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787782135.250178:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787782135.250193:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787782135.250207:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787782135.250240:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787782135.250257:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787782135.250271:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787782135.250286:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787782135.250300:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787782135.250314:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787782135.251082:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787782135.251108:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787782135.251124:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787782135.251152:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787782135.251166:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787782135.251180:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787782135.251192:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787782135.251203:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787782135.251213:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787782135.251224:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787782135.251252:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787782135.251269:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787782135.251283:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787782135.251295:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787782135.251308:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787782135.251699:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787782135.251718:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787782135.251733:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787782135.251747:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787782135.251761:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787782135.251775:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787782135.251788:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787782135.251802:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787782135.251815:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787782135.251829:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787782135.251842:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787782135.252549:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787782135.252570:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787782135.252583:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787782135.252594:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787782135.252605:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787782135.252648:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787782135.252662:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787782135.252676:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787782135.252692:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787782135.252751:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782135.252824:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.254997:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787782135.255542:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089792 00000100:00100000:0.0:1787782135.255551:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089792 00000100:00100000:0.0:1787782135.255676:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787782135.255687:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782135.255827:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089792:12345-0@lo:502:mount.lustre.0 Request processed in 142us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.255835:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787782135.258295:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d49161680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782135.258537:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787782135.258566:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787782135.258604:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782135.258687:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.259046:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80ac6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782135.259264:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963089920 00000100:00100000:3.0:1787782135.259271:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963089920 00000100:00100000:3.0:1787782135.259311:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787782135.259320:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782135.259797:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963089920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782135.259852:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787782135.259862:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:3.0:1787782135.260217:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963089920:12345-0@lo:502:mount.lustre.0 Request processed in 896us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.260225:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:01000004:2.0:1787782135.264047:0:19541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787782135.264068:0:19541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff993c41d6cd28) 00000020:00000080:2.0:1787782135.264091:0:19541:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787782135.264176:0:19541:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c410b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782135.264180:0:19541:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993c410b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782135.264182:0:19541:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993c410b3800 3 00010000:00080000:2.0:1787782135.264223:0:19541:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c43f63800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.116@tcp at head 00010000:00010000:2.0:1787782135.267124:0:19541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787782135.267332:0:19541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787782135.267375:0:19541:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782135.267387:0:19541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6d6745c1506475b 00000100:00080000:2.0:1787782135.267396:0:19541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782135.267402:0:19541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff993c43f63800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782135.269575:0:19541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd8000 x1874624963090048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782135.269623:0:19541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787782135.269661:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963090048:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787782135.269685:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782135.269689:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782135.269692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782135.269695:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787782135.269764:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782135.269778:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963090176:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.269808:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782135.269808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787782135.269878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782135.269882:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787782135.269884:0:8:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782135.269890:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1787782135.269894:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787782135.269901:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782135.269920:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd83c0 x1874624963090688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782135.269973:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963090816:0@lo:400:kworker.0 00000100:00100000:0.0:1787782135.270046:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090176 00000100:00100000:0.0:1787782135.270053:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090176 00000100:00100000:0.0:1787782135.270093:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782135.270102:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963090176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270280:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963090560:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270309:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.270339:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963090304:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270361:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.270376:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963090944:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270393:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.270407:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782135.270412:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963090432:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270432:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.270459:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963091072:0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270480:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.270503:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090048 00000100:00100000:3.0:1787782135.270507:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090048 00000100:00100000:3.0:1787782135.270536:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090304 00000100:00100000:3.0:1787782135.270539:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090304 00000100:00100000:3.0:1787782135.270556:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090944 00000100:00100000:3.0:1787782135.270559:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090944 00000100:00100000:3.0:1787782135.270570:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091072 00000100:00100000:3.0:1787782135.270572:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091072 00000100:00100000:3.0:1787782135.270583:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782135.270590:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963090304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270644:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963090304:12345-0@lo:400:kworker.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.270652:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782135.270675:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782135.270681:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963090944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270711:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963090944:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.270717:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782135.270728:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782135.270733:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963091072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270761:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874624963091072:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.270766:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782135.270777:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782135.270781:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1874624963090048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787782135.270800:0:18983:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:3.0:1787782135.270832:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6d6745c15064762 00000004:00100000:3.0:1787782135.270847:0:18983:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787782135.270880:0:18983:0:(import.c:65:import_set_state_nolock()) ffff993d6ce12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782135.270912:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874624963090048:12345-0@lo:38:llog_process_th.0 Request processed in 129us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.270918:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782135.270937:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090432 00000100:00100000:3.0:1787782135.270940:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090432 00000100:00100000:3.0:1787782135.270956:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782135.270961:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963090432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.270991:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963090432:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.270996:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782135.271042:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963090432:0@lo:400:kworker.0 00010000:00080000:3.0:1787782135.271054:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd7840 x1874624963091072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782135.271063:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1874624963091072:0@lo:400:kworker.0 00010000:00080000:3.0:1787782135.271071:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd92c0 x1874624963090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782135.271080:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963090304:0@lo:400:kworker.0 00010000:00080000:3.0:1787782135.271089:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd4000 x1874624963090944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782135.271097:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963090944:0@lo:400:kworker.0 00000100:00100000:2.0:1787782135.273263:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.273384:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090560 00000100:00100000:2.0:1787782135.273394:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090560 00000100:00100000:2.0:1787782135.273685:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782135.273698:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782135.273764:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963090560:12345-0@lo:400:kworker.0 Request processed in 70us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.273771:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782135.273771:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd8000 x1874624963090048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782135.273782:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782135.273792:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787782135.273799:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787782135.273804:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787782135.273807:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c43f63800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1787782135.273808:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd9680 x1874624963090560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782135.273813:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1874624963090048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782135.273817:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963090560:0@lo:400:kworker.0 00000100:00100000:1.0:1787782135.273836:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963090688:0@lo:8:kworker.0 00000100:00100000:1.0:1787782135.273869:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.273879:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090816 00000100:00100000:3.0:1787782135.273883:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090816 00000100:00100000:3.0:1787782135.273910:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782135.273939:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963090688 00000100:00100000:2.0:1787782135.273943:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963090688 00000100:00100000:2.0:1787782135.273963:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782135.273967:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624963090688:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787782135.274020:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1874624963090688:12345-0@lo:8:kworker.0 Request processed in 51us (150us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787782135.274025:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782135.274062:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963090816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782135.274108:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963090816:12345-0@lo:400:kworker.0 Request processed in 192us (852us total) trans 0 rc 0/0 00010000:00080000:2.0:1787782135.274161:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fda580 x1874624963090816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782135.274172:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963090816:0@lo:400:kworker.0 00000100:00100000:0.0:1787782135.274264:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d49163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963090176:12345-0@lo:400:kworker.0 Request processed in 4161us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.274274:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787782135.274554:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963090176:0@lo:400:kworker.0 00000020:01000004:2.0:1787782135.274690:0:19541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787782135.274746:0:19541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff993c41d68000) 00000020:00000080:2.0:1787782135.274770:0:19541:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787782135.274865:0:19541:0:(tgt_mount.c:153:server_get_mount()) get mount ffff993c410b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782135.274870:0:19541:0:(tgt_mount.c:187:server_put_mount()) put mount ffff993c410b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782135.274873:0:19541:0:(obd_mount.c:710:lustre_put_lsi()) put ffff993c410b3800 3 00010000:00080000:2.0:1787782135.274902:0:19541:0:(ldlm_lib.c:102:import_set_conn()) imp ffff993c43f61000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.116@tcp at head 00000100:00100000:1.0:1787782135.275122:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782135.275141:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782135.275146:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787782135.275150:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963090688:0@lo:8:kworker.0 00000100:00100000:3.0:1787782135.275236:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787782135.276677:0:19541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787782135.276864:0:19541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787782135.276907:0:19541:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782135.276919:0:19541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc6d6745c15064770 00000100:00080000:2.0:1787782135.276928:0:19541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782135.276933:0:19541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff993c43f61000 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:2.0:1787782135.276965:0:19541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d67fd6580 x1874624963091200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782135.276984:0:19541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787782135.277159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782135.277164:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787782135.277166:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782135.277169:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782135.278054:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624963091200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787782135.278124:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.278668:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091200 00000100:00100000:2.0:1787782135.278677:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091200 00000100:00100000:2.0:1787782135.278713:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782135.278721:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1874624963091200:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787782135.278749:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:2.0:1787782135.278793:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc6d6745c15064777 00000004:00100000:2.0:1787782135.278809:0:17209:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787782135.278841:0:17209:0:(import.c:65:import_set_state_nolock()) ffff993c4338f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782135.278895:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874624963091200:12345-0@lo:38:llog_process_th.0 Request processed in 174us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.278902:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787782135.278944:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff993d67fd6580 x1874624963091200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782135.278964:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782135.278972:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787782135.278979:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787782135.278983:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787782135.278986:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993c43f61000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787782135.278992:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1874624963091200:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787782135.279089:0:19541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787782135.279252:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787782135.279285:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787782135.279342:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506474d expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782135.279353:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43704a00/0xc6d6745c15064746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c1506474d expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787782135.279400:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787782135.279403:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787782135.279404:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782135.279405:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782135.279406:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782135.279408:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782135.279409:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782135.279411:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782135.279412:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787782135.279415:0:19528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787782135.279417:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782135.279419:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787782135.279420:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782135.279421:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782135.279422:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782135.279423:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782135.279424:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782135.279425:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782135.279426:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787782135.279520:0:19528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787782135.279537:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963091328:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782135.279577:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.279602:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d6d8bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782135.279715:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091328 00000100:00100000:3.0:1787782135.279720:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091328 00000100:00100000:3.0:1787782135.279758:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787782135.279765:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963091328:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787782135.279785:0:17201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787782135.279803:0:17201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787782135.288140:0:17201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787782135.288182:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787782135.288374:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787782135.288379:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787782135.288399:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288417:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150646eb expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288425:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288444:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288482:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288495:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782135.288510:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963091456:0@lo:104: 00000100:00100000:1.0:1787782135.288573:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782135.288697:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782135.288706:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 24 pid: 17201 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782135.288715:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963091584:0@lo:104: 00000100:00100000:1.0:1787782135.288737:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782135.288755:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d456a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782135.288879:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:19528:x1874624963091328:12345-0@lo:253:mount.lustre.0 Request processed in 9112us (9299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.288889:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787782135.289091:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091456 00000100:00100000:2.0:1787782135.289098:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091456 00000100:00100000:2.0:1787782135.289220:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091584 00000100:00100000:2.0:1787782135.289224:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091584 00000100:00100000:2.0:1787782135.289242:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782135.289250:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963091456:12345-0@lo:104: 00010000:00010000:2.0:1787782135.289262:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.289391:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782135.289397:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:17225:x1874624963091456:12345-0@lo:104: Request processed in 148us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.289404:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782135.289419:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782135.289425:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963091584:12345-0@lo:104: 00010000:00010000:2.0:1787782135.289433:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.289474:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787782135.289488:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:17225:x1874624963091584:12345-0@lo:104: Request processed in 62us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.289493:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787782135.289510:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782135.289516:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.289523:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5200 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782135.289526:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.289535:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782135.289541:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782135.289547:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782135.289798:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787782135.289839:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:919c9bfc-060e-4da8-a874-7b13cf1bdaec:19528:1874624963091328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787782135.289852:0:19528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787782135.289855:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782135.289857:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787782135.289858:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782135.289859:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782135.289861:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782135.289862:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782135.289869:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782135.289871:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782135.289872:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787782135.289887:0:19528:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787782135.290058:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963091456:0@lo:104: 00000100:00100000:3.0:1787782135.290066:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe03c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1874624963091584:0@lo:104: 00010000:00010000:3.0:1787782135.290083:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.292519:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.292533:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782135.292560:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.292567:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d412e5200/0xc6d6745c150646f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064700 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.292586:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782135.292588:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782135.292590:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782135.292705:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963091712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782135.292767:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782135.292820:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091712 00000100:00100000:0.0:1787782135.292828:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091712 00010000:00010000:0.0:1787782135.292856:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782135.292895:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782135.292903:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3657:x1874624963091712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782135.292913:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782135.292918:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.292929:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.292950:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8600/0xc6d6745c15064700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150646f9 expref: 24 pid: 17204 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.292963:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782135.293060:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:3657:x1874624963091712:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782135.293068:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782135.293146:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963091712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782135.293827:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782135.293830:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782135.293832:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782135.294062:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294072:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8c00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782135.294076:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294084:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782135.294092:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782135.294097:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782135.294149:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294156:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782135.294184:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294191:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150646eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646f2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294216:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782135.294218:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782135.294220:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782135.294236:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963091840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782135.294280:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782135.294469:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091840 00000100:00100000:2.0:1787782135.294476:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091840 00010000:00010000:2.0:1787782135.294502:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 23 pid: 17201 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782135.294527:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782135.294534:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:3658:x1874624963091840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782135.294545:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782135.294550:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 23 pid: 17201 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294559:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 23 pid: 17201 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294571:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e4e00/0xc6d6745c150646f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c150646eb expref: 23 pid: 17201 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294585:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294594:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782135.294630:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007029394s 00010000:00010000:2.0:1787782135.294641:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294649:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294655:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294661:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294667:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782135.294687:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294694:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294713:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782135.294725:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782135.294731:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294741:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782135.294747:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43dfb400/0xc6d6745c1506477e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782135.294770:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3658:x1874624963091840:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782135.294778:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782135.294786:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963091840:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787782135.312762:0:19528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787782135.317859:0:19528:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787782135.317868:0:19528:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787782135.317896:0:19528:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787782135.317932:0:19528:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787782135.318383:0:19528:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787782135.318404:0:19528:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787782135.319436:0:19528:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787782135.319719:0:19528:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787782135.814332:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963092096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782135.814410:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.814463:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782135.814469:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963091968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782135.814490:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782135.814522:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092096 00000100:00100000:3.0:1787782135.814529:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092096 00000100:00100000:3.0:1787782135.814568:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963091968 00000100:00100000:3.0:1787782135.814571:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963091968 00000100:00100000:3.0:1787782135.814585:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787782135.814593:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963092096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787782135.814651:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782135.814696:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963092096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.814703:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787782135.814737:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782135.814744:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963091968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787782135.814775:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787782135.814804:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963091968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782135.814810:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782135.814850:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963091968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782135.814861:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963092096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787782136.198145:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787782136.223467:0:19595:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787782136.224007:0:19595:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787782136.326691:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782116/real 1787782116] req@ffff993c431a7c00 x1874624963078272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782136.326835:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c431a7c00 x1874624963078272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782136.326846:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782116/real 1787782116] req@ffff993c431a6d00 x1874624963078400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782136.326857:0:3656:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff993c431a6d00 x1874624963078400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787782136.326877:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782136.326899:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782136.326903:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963078272:0@lo:8:kworker.0 00000100:00080000:1.0:1787782136.326909:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782136.326914:0:3656:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787782136.326917:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963078400:0@lo:8:kworker.0 00000100:00100000:1.0:1787782136.327271:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963092224:0@lo:400:kworker.0 00000100:00100000:1.0:1787782136.327333:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782136.327411:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092224 00000100:00100000:3.0:1787782136.327419:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092224 00000100:00100000:3.0:1787782136.327467:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787782136.327475:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3657:x1874624963092224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782136.328387:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3657:x1874624963092224:12345-0@lo:400:kworker.0 Request processed in 911us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782136.328398:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787782136.328711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782136.328716:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787782136.328720:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782136.328725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1787782136.328736:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787782136.328743:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff993d67b7f800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782136.328769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d6d07f0c0 x1874624963092480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782136.328789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782136.328793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787782136.328795:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782136.328798:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1787782136.328801:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787782136.328804:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff993d67b78800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782136.328816:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d6d07c780 x1874624963092608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782136.328855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782136.328859:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787782136.328861:0:37:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782136.328865:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff993d4bec6800 using connection 192.168.206.116@tcp/0@lo 00000100:00100000:0.0:1787782136.328878:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff993d6d07cb40 x1874624963093120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782136.328926:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963092224:0@lo:400:kworker.0 00000100:00100000:0.0:1787782136.328933:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963092352:0@lo:400:kworker.0 00000100:00100000:3.0:1787782136.328966:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963092992:0@lo:400:kworker.0 00000100:00100000:0.0:1787782136.328976:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782136.329004:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782136.329013:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963093248:0@lo:400:kworker.0 00000100:00100000:3.0:1787782136.329028:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963093632:0@lo:400:kworker.0 00000100:00100000:1.0:1787782136.329041:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092352 00000100:00100000:0.0:1787782136.329046:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.329048:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092352 00000100:00100000:0.0:1787782136.329071:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963093760:0@lo:400:kworker.0 00000100:00100000:1.0:1787782136.329082:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787782136.329089:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782136.329102:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963092736:0@lo:400:kworker.0 00000100:00100000:3.0:1787782136.329139:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782136.329150:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963092864:0@lo:400:kworker.0 00000100:00100000:1.0:1787782136.329154:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963092352:12345-0@lo:400:kworker.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782136.329162:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782136.329178:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782136.329186:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093248 00000100:00100000:3.0:1787782136.329191:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093248 00000100:00100000:0.0:1787782136.329203:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963093504:0@lo:400:kworker.0 00000100:00100000:3.0:1787782136.329216:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093632 00000100:00100000:3.0:1787782136.329220:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093632 00000100:00100000:0.0:1787782136.329229:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.329910:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963092480:0@lo:8:kworker.0 00000100:00100000:1.0:1787782136.330150:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092864 00000100:00100000:1.0:1787782136.330156:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092864 00000100:00100000:1.0:1787782136.330189:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787782136.330196:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963092864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.330374:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.330413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963092608:0@lo:8:kworker.0 00000100:00100000:1.0:1787782136.330440:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963092864:12345-0@lo:400:kworker.0 Request processed in 242us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.330448:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.330451:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787782136.330484:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963093120:0@lo:8:kworker.0 00000100:00100000:2.0:1787782136.330513:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782136.330528:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093504 00000100:00100000:0.0:1787782136.330534:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093504 00000100:00100000:2.0:1787782136.330546:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092992 00000100:00100000:2.0:1787782136.330552:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092992 00000100:00100000:0.0:1787782136.330576:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782136.330579:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092480 00000100:00100000:2.0:1787782136.330583:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092480 00000100:00100000:0.0:1787782136.330588:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963093248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.330595:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092608 00000100:00100000:2.0:1787782136.330599:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092608 00000100:00100000:2.0:1787782136.330627:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093120 00000100:00100000:2.0:1787782136.330630:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093120 00000100:00100000:2.0:1787782136.330645:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782136.330661:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963093248:12345-0@lo:400:kworker.0 Request processed in 76us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.330669:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782136.330764:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.330786:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963093376:0@lo:400:kworker.0 00000100:00100000:1.0:1787782136.330813:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.330836:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.330864:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963092352:0@lo:400:kworker.0 00010000:00080000:1.0:1787782136.330878:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07fc00 x1874624963093248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782136.330888:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963093248:0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.330933:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.330985:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963092992:12345-0@lo:400:kworker.0 Request processed in 333us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.330992:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782136.331006:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782136.331010:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1874624963092480:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.331033:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:2.0:1787782136.331057:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c15064785 00002000:00100000:2.0:1787782136.331069:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff993c43f64800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787782136.331144:0:18718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787782136.331147:0:18718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787782136.331217:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:1.0:1787782136.331225:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07d680 x1874624963092992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782136.331240:0:18718:0:(import.c:65:import_set_state_nolock()) ffff993c43f62800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782136.331280:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624963092480:12345-0@lo:8:kworker.0 Request processed in 268us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.331287:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782136.331300:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782136.331314:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1874624963092608:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.331329:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:2.0:1787782136.331344:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6d6745c1506478c 00002000:00100000:2.0:1787782136.331349:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff993c43f67800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787782136.331353:0:18718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787782136.331355:0:18718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787782136.331476:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787782136.331490:0:18718:0:(import.c:65:import_set_state_nolock()) ffff993c43f60800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782136.331519:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874624963092608:12345-0@lo:8:kworker.0 Request processed in 205us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.331526:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782136.331537:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782136.331541:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1874624963093120:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.331554:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:2.0:1787782136.331568:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc6d6745c15064793 00002000:00100000:2.0:1787782136.331573:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff993c43f65000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787782136.331576:0:18718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787782136.331578:0:18718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787782136.331597:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787782136.331629:0:18718:0:(import.c:65:import_set_state_nolock()) ffff993c43f62000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782136.331655:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3656:x1874624963093120:12345-0@lo:8:kworker.0 Request processed in 112us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.331661:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782136.331681:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963092736 00000100:00100000:2.0:1787782136.331686:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963092736 00000100:00100000:1.0:1787782136.331703:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963092992:0@lo:400:kworker.0 00000100:00100000:0.0:1787782136.331849:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093376 00000100:00100000:0.0:1787782136.331853:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093376 00000100:00100000:2.0:1787782136.331873:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093760 00000100:00100000:0.0:1787782136.331878:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782136.331885:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093760 00000100:00100000:0.0:1787782136.331887:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.331914:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782136.331923:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.331964:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963093504:12345-0@lo:400:kworker.0 Request processed in 42us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.331970:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782136.331984:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787782136.331990:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963092736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.332024:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874624963092736:12345-0@lo:400:kworker.0 Request processed in 34us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.332030:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787782136.332041:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787782136.332047:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963093376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.332150:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874624963093376:12345-0@lo:400:kworker.0 Request processed in 102us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.332156:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787782136.332170:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787782136.332176:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.332209:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963093760:12345-0@lo:400:kworker.0 Request processed in 34us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.332215:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787782136.332254:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f0c0 x1874624963092480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.332264:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782136.332270:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787782136.332277:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787782136.332289:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787782136.332291:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b7f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787782136.332304:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787782136.332309:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963092480:0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.332324:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c780 x1874624963092608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.332332:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782136.332336:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787782136.332341:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787782136.332343:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787782136.332345:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d67b78800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787782136.332359:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787782136.332362:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1874624963092608:0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.332372:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07cb40 x1874624963093120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782136.332381:0:3656:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787782136.332385:0:3656:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787782136.332388:0:3656:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787782136.332390:0:3656:0:(import.c:65:import_set_state_nolock()) ffff993d4bec6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787782136.332399:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787782136.332402:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1874624963093120:0@lo:8:kworker.0 00010000:00080000:2.0:1787782136.332433:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07de00 x1874624963092736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.332441:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874624963092736:0@lo:400:kworker.0 00010000:00080000:2.0:1787782136.332456:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07e1c0 x1874624963093376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.332469:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1874624963093376:0@lo:400:kworker.0 00010000:00080000:2.0:1787782136.332495:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07da40 x1874624963093760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.332503:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963093760:0@lo:400:kworker.0 00000004:00080000:2.0:1787782136.332518:0:17233:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787782136.332577:0:17233:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 573413968866ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787782136.332582:0:17233:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787782136.332648:0:17954:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787782136.332667:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094016:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787782136.332696:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.332727:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787782136.333388:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874624963093632:12345-0@lo:400:kworker.0 Request processed in 1499us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.333397:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787782136.333443:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963092864:0@lo:400:kworker.0 00010000:00080000:0.0:1787782136.333460:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07e940 x1874624963093504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782136.333470:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963093504:0@lo:400:kworker.0 00000100:00100000:2.0:1787782136.333480:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094016 00000100:00100000:2.0:1787782136.333486:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094016 00000100:00100000:0.0:1787782136.333488:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782136.333498:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963093888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782136.333523:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782136.333532:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.333534:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17954:x1874624963094016:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787782136.333594:0:17236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787782136.333641:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1874624963094272:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787782136.333669:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782136.333686:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d467eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782136.333709:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963093888 00000100:00100000:0.0:1787782136.333725:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963093888 00000100:00100000:0.0:1787782136.333752:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782136.333758:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3660:x1874624963093888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782136.333771:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787782136.333820:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3660:x1874624963093888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.333827:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782136.333846:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963094144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782136.333868:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.333891:0:18716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00010000:00080000:0.0:1787782136.333893:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd4b40 x1874624963093888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.333901:0:18716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787782136.333916:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963093888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782136.333944:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787782136.333952:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094272 00000100:00100000:0.0:1787782136.333955:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094272 00000100:00100000:0.0:1787782136.333984:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094144 00000100:00100000:0.0:1787782136.333987:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094144 00000100:00100000:0.0:1787782136.334003:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782136.334010:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963094144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782136.334021:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787782136.334052:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874624963094144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.334067:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787782136.334091:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07f840 x1874624963094144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782136.334103:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963094144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782136.334306:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782136.334316:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17236:x1874624963094272:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787782136.335278:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:1.0:1787782136.335436:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d6d07c3c0 x1874624963093632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782136.335449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1874624963093632:0@lo:400:kworker.0 00000100:00100000:0.0:1787782136.335541:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963094400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787782136.336196:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782136.336201:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782136.336204:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787782136.336214:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787782136.336225:0:17235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787782136.336374:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.336450:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094400 00000100:00100000:2.0:1787782136.336457:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094400 00000004:00080000:1.0:1787782136.336463:0:17234:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787782136.336494:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1874624963094528:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787782136.336507:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782136.336517:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963094400:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782136.336532:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787782136.336541:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782136.336551:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adcb40 going to sleep for 11 seconds 00000004:00080000:1.0:1787782136.336577:0:17953:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787782136.336754:0:17953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 573418145638ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787782136.336760:0:17953:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1787782136.336997:0:17235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 573418388420ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787782136.337004:0:17235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1787782136.337028:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782136.339295:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787782136.339312:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787782136.339540:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094528 00000100:00100000:1.0:1787782136.339549:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094528 00000100:00100000:1.0:1787782136.340319:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782136.340332:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:17234:x1874624963094528:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787782136.346290:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3657:x1874624963094400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9765us (9906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.346305:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787782136.346922:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43e41680 x1874624963094400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782136.346950:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963094400:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787782136.347006:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787782136.347213:0:19602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787782136.347222:0:19602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787782136.347229:0:19602:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:2.0:1787782136.348477:0:18718:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787782136.348488:0:18718:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787782136.348590:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17954:x1874624963094016:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15055us (15888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.348602:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787782136.348695:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd61c0 x1874624963094016/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787782152 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.348710:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094016:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787782136.348723:0:17954:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787782136.348761:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094656:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787782136.348792:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.348816:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782136.348833:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094656 00000100:00100000:2.0:1787782136.348839:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094656 00000100:00100000:2.0:1787782136.348877:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787782136.348886:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17954:x1874624963094656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787782136.348936:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787782136.348970:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17954:x1874624963094656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.348977:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787782136.349003:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd61c0 x1874624963094656/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782152 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.349013:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094656:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787782136.349031:0:17954:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787782136.349056:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094784:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787782136.351158:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.351209:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c431cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787782136.352190:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094784 00000100:00100000:0.0:1787782136.352200:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094784 00000100:00100000:0.0:1787782136.352254:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782136.352264:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17954:x1874624963094784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787782136.352311:0:18718:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1787782136.355288:0:19601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787782136.355303:0:19601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787782136.355309:0:19601:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:1.0:1787782136.373834:0:17942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1787782136.373921:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.373931:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.373949:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.373954:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.373961:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.373978:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.373997:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.374005:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.374028:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782136.379716:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.379729:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379745:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.379750:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.379756:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379774:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379793:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379801:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379817:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782136.379828:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782136.379835:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379841:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.379846:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379855:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379871:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379877:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cdda4a3/0xc6d6745c1506479a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379892:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.379903:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379909:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.379912:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379919:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379931:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379937:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000081dd7e/0xc6d6745c150647a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.379949:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.379951:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.379952:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.380378:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.380384:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380393:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.380396:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.380400:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380422:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380430:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380437:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380455:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.380463:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.380467:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380474:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.380477:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380485:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380496:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380503:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda65914/0xc6d6745c150647a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380522:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.380524:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.380526:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.380845:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.380851:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380860:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.380863:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.380867:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380877:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380884:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380892:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.380912:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.380940:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.380947:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.380954:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.380957:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.380966:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.380977:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.380985:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecbf4991/0xc6d6745c150647af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.380998:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.381005:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.381007:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.381206:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.381211:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381228:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.381231:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.381235:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381244:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381251:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381258:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381271:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.381278:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.381282:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381289:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.381293:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381300:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381322:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381329:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006637260/0xc6d6745c150647b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381341:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.381343:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.381345:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.381636:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.381642:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381650:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.381653:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.381658:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381666:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381685:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381692:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.381720:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.382213:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.382220:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.382229:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.382233:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.382242:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.382255:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.382262:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a57f8c56/0xc6d6745c150647bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.382278:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.382673:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.382675:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.382702:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.382709:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382720:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.382725:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.382730:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382741:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382749:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382757:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382772:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.382781:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.382785:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382792:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.382805:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382814:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382826:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382832:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c150647c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.382845:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.382847:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.382849:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.383896:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.383904:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.383917:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.383920:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.383926:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.383936:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.383945:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.383957:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.383979:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.384362:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.384368:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.384376:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.384380:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.384396:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.384412:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.384420:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e27db47/0xc6d6745c150647cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.384435:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.384437:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.384439:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.384504:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.384510:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384520:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.384523:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.384527:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384536:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384544:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384551:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384563:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.384570:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.384574:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384588:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.384591:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384599:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384627:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384636:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2006b7b/0xc6d6745c150647d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.384649:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.384651:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.384652:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.386862:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.386873:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.386889:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.386894:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.386901:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.386914:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.386930:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.386939:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.386965:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.386970:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.386977:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.386984:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.386988:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.386996:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.387012:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.387029:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f923fb85/0xc6d6745c150647d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.387046:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.387048:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.387050:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.387502:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.388077:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.388083:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388094:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.388097:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.388101:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388110:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388117:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388136:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388159:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.388167:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.388171:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388177:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.388181:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388189:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388200:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388207:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8c884a1/0xc6d6745c150647e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.388219:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.388220:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.388222:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.389135:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.389143:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389153:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.389161:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.389166:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389176:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389185:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389192:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389205:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787782136.389582:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.389588:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.389597:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.389600:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.389604:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.389642:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.389650:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.389657:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.389695:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782136.389865:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782136.389871:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389879:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.389883:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389892:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389906:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389923:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abe12a03/0xc6d6745c150647e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389938:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.389941:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389948:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.389951:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389958:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389971:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389978:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150647ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.389991:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.389992:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.389994:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.390324:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.390661:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.390680:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.390691:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.390694:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.390699:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.390710:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.390719:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.390726:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.390739:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.390924:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.390930:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.390942:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.390946:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.390954:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.390966:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.390973:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389ccc86/0xc6d6745c150647f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.390988:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.390989:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.390991:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.391030:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.391035:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391044:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.391047:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.391051:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391060:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391073:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391079:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391097:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.391105:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.391108:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391115:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.391118:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391136:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391148:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391155:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150647fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.391167:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.391172:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.391174:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.392053:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.392061:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392073:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.392076:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.392081:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392091:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392099:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392106:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392135:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787782136.392445:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.392452:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392462:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.392469:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.392474:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392485:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392493:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392501:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392517:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787782136.392526:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782136.392531:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392539:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.392543:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392551:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392564:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392582:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392602:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.392627:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392635:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.392638:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392645:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392656:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.392663:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506480a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787782136.392745:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.392750:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392759:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.392762:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.392766:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392781:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392789:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392796:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392810:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.392818:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.392822:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392829:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.392832:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392840:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392850:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392857:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.392875:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.392877:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.392879:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.393137:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.393139:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.393141:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.393403:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.393409:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393425:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.393429:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.393433:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393443:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393450:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393457:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393474:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.393637:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.393642:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.393649:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.393652:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.393658:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.393670:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.393683:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c15064818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.393696:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.393698:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.393699:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.393913:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.393919:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393928:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.393931:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.393936:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393944:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393962:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393967:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393980:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.393988:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.393991:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.393997:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.394000:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394007:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394017:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394023:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c1506481f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394037:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.394044:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.394046:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.394233:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.394239:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.394258:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.394261:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.394265:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.394274:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.394281:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.394289:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.394308:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.394767:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.394773:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394781:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.394785:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394792:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394803:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394810:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f058f669/0xc6d6745c15064826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394822:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.394824:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.394825:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.394894:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.394899:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394908:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.394911:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.394920:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394930:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394937:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394944:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394956:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.394964:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.394968:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394974:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.394977:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394985:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.394995:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395013:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c1506482d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395026:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.395028:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.395030:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.395182:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.395188:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395196:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.395200:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.395204:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395213:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395230:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395237:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395256:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782136.395579:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.395585:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395594:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.395597:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.395601:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395633:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395641:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395648:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.395789:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787782136.395810:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782136.395815:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395823:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40031a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.395826:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395834:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395845:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395852:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfeb4e9/0xc6d6745c15064834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395865:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.395868:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395880:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40031600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.395883:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395890:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395900:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395906:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab799ff2/0xc6d6745c1506483b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395917:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.395918:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.395920:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.395959:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.395965:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395973:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.395976:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.395979:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.395988:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396001:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396007:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396018:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.396025:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.396028:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396034:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.396037:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396044:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396055:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396063:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e433883/0xc6d6745c15064842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396074:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.396081:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.396083:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782136.396394:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787782136.396400:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396409:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1787782136.396412:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782136.396416:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396424:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396433:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396440:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396453:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.396459:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.396463:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396471:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.396474:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396492:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396502:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396510:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb013a2/0xc6d6745c15064849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.396523:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.396525:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.396527:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.397558:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.399523:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.399881:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.399891:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.399907:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.399912:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.399919:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.399934:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.399945:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.399953:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.399984:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.399991:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.399998:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.400005:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.400009:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.400017:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.400034:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.400050:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c15064850 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.400066:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.400068:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.400069:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.403108:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.403131:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403149:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.403153:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.403159:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403171:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403181:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403188:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403207:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782136.403592:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.403599:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403625:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.403635:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.403639:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403649:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403658:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403666:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.403736:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787782136.404831:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.404840:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.404853:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.404857:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.404862:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.404873:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.404881:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.404896:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.404920:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787782136.406377:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782136.406388:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406401:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.406406:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406418:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406436:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406443:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7a386d6/0xc6d6745c15064857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406461:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782136.406465:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406471:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.406474:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406495:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406505:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406512:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c48476/0xc6d6745c1506485e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406527:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.406530:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406537:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40031e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.406540:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406548:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406558:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406564:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e903746/0xc6d6745c15064865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.406589:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.406590:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.406592:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782136.406840:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787782136.406850:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787782136.406856:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787782136.406982:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17954:x1874624963094784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54716us (55830us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787782136.406991:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:1.0:1787782136.407209:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.407217:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407228:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.407233:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.407238:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407250:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407259:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407267:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407364:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.407372:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.407377:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407383:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.407387:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407396:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407407:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407415:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506486c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.407428:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.407430:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.407431:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.408678:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.409044:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.409054:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409069:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.409075:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.409082:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409095:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409105:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409112:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409148:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.409213:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.409221:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409244:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030600 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.409248:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409258:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409275:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409362:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7ab02ad/0xc6d6745c15064873 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409383:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.409385:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.409386:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.409646:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.409816:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.409823:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409838:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.409841:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.409846:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409855:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409862:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409869:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.409885:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782136.409982:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.409988:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.409997:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.410000:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.410003:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410013:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410028:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410035:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410049:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787782136.410057:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782136.410061:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410068:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d40030400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.410071:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782136.410136:0:17954:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787782136.410147:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1874624963094784:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1787782136.410160:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782136.410162:0:17954:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:1.0:1787782136.410171:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410178:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f058f669/0xc6d6745c1506487a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410192:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.410201:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410207:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfae00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.410209:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782136.410216:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1874624963094912:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787782136.410217:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410226:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410232:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c15064881 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.410243:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.410245:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.410246:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782136.410276:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.410309:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80acdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782136.410328:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963094912 00000100:00100000:2.0:1787782136.410333:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963094912 00000100:00100000:2.0:1787782136.410396:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782136.410404:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1874624963094912:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787782136.410458:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1874624963094912:12345-0@lo:900:osp-pre-1-1.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782136.410465:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787782136.410501:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd61c0 x1874624963094912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787782152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782136.410511:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1874624963094912:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787782136.411788:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.412747:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.412759:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.412774:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.412779:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.412785:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.412798:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.412819:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.412826:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.412846:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782136.412967:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.412973:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.412982:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.412985:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.412989:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.413009:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.413017:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.413024:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.413045:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782136.413272:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782136.413278:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413287:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.413291:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413301:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413316:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413324:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005198145b/0xc6d6745c15064888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413341:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.413351:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413358:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.413361:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413369:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413380:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413386:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002603ba10/0xc6d6745c1506488f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.413401:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.413403:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.413404:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.413777:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.414308:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.414315:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.414327:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.414330:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.414336:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.414358:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.414368:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.414376:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.414671:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.415041:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.415048:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.415056:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.415059:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.415067:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.415084:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.415090:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006998be7d/0xc6d6745c15064896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.415115:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.415117:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.415118:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.415246:0:19602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.415253:0:19602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415262:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.415266:0:19602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.415271:0:19602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415281:0:19602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415289:0:19602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415308:0:19602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415323:0:19602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.415331:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.415335:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415342:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.415345:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415352:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415362:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415370:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8fa6ac4/0xc6d6745c1506489d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.415384:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.415385:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.415387:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787782136.415424:0:19602:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787782136.415664:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17234:x1874624963094528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 75331us (79128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.415679:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782136.415870:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1874624963094528:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787782136.415884:0:17234:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787782136.415922:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1874624963095040:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787782136.415955:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.415980:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d47cb4540 going to sleep for 11 seconds 00002000:00010000:1.0:1787782136.416042:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.416049:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.416059:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.416062:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.416067:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.416077:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.416086:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.416094:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.416114:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782136.416183:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095040 00000100:00100000:2.0:1787782136.416189:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095040 00000100:00100000:2.0:1787782136.416222:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787782136.416230:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17234:x1874624963095040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787782136.416262:0:18716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1787782136.416336:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.416341:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.416349:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfae00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.416353:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.416360:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.416373:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.416380:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984dec4d/0xc6d6745c150648a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.416395:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.416396:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.416398:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.417803:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.417814:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.417829:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.418135:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.418144:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418158:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418169:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418176:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418195:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782136.418206:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.418212:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418219:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.418231:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418240:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418253:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418261:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c150648ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.418850:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.418853:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.418855:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.420902:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.420916:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.420934:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.420938:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.420945:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.420958:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.420969:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.420986:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421017:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782136.421880:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.421889:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421900:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.421904:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.421909:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421919:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421928:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421935:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.421958:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787782136.423146:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.423157:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.423178:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.423182:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.423186:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.423197:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.423206:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.423214:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.424994:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787782136.425016:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782136.425024:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425033:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfba00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.425037:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425048:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425086:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425095:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c150648b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425118:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782136.425132:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425139:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.425143:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425151:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425160:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425168:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425179:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.425182:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425195:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.425198:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425206:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425216:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425223:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.425237:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.425238:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.425240:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.425999:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.427195:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.428042:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.428051:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.428067:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.428072:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.428078:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.428092:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.428108:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.428115:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.428146:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.428417:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.428425:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.428434:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.428439:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.428448:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.428464:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.428472:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000658bf2e2/0xc6d6745c150648c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.428486:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.428487:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.428489:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.429711:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.429847:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429862:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.429871:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.429877:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429889:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429899:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429907:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429923:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.429933:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.429938:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429946:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.429949:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429958:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429971:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.429989:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005198145b/0xc6d6745c150648ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430006:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.430008:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.430010:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.430895:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.430903:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430914:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.430917:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.430922:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430931:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430938:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430946:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.430969:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.432393:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.432407:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.432425:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.432429:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.432438:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.432454:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.432462:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fa6ac4/0xc6d6745c150648d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.432479:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.432480:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.432482:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.432903:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.432916:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.432927:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.432932:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.432938:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.432948:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.432957:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.432964:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.432981:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.432990:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.432994:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.433000:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.433003:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.433011:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.433029:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.433037:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a4f222/0xc6d6745c150648dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.433050:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.433052:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.433054:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.434948:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.434959:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.434973:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.434977:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.434983:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.434995:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435004:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435012:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435040:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.435051:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.435056:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435063:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4c00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.435068:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435076:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435090:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435097:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000389ccc86/0xc6d6745c150648e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.435113:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.435114:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.435116:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.437056:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.437067:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.437084:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.437098:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.437104:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.437116:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.437137:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.437145:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.437167:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.437230:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.437237:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.437245:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4e00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.437249:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.437258:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.437352:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.437362:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006998be7d/0xc6d6745c150648ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.437379:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.437381:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.437383:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782136.438502:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.438510:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438522:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.438527:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.438532:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438544:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438553:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438567:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438582:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.438592:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.438596:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.438603:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.439880:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.439895:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.439913:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.439921:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c150648f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.439939:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.439941:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.439943:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.441098:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.441107:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.441131:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.441136:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.441142:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.441154:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.441163:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.441171:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.441198:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782136.442504:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.442515:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.442529:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.442532:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.442538:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.442549:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.442557:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.442564:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.442586:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787782136.442808:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782136.442816:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442824:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.442828:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442837:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442852:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442859:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cdda4a3/0xc6d6745c150648f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442887:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.442891:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442896:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfb200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.442905:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442913:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442922:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442929:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000070560bb/0xc6d6745c150648ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.442941:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.442943:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.442944:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.444869:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.444939:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.444948:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.444962:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.444974:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.444980:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.444993:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.445002:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.445009:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.445027:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782136.445332:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782136.445340:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.445355:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfba00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782136.445360:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.445369:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.445385:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.445392:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035492b79/0xc6d6745c15064906 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.445409:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.445410:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782136.445412:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782136.447091:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787782136.447102:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.447117:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1787782136.447132:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782136.447138:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.447151:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.447162:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.447178:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.447201:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782136.449218:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782136.449229:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.449243:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa200 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:2.0:1787782136.449254:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.449265:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.449584:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.449593:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2634fe/0xc6d6745c1506490d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.449633:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.449635:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782136.449637:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787782136.450335:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787782136.450371:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787782136.450738:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17234:x1874624963095040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 34505us (34779us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787782136.450748:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782136.450792:0:17234:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787782136.450799:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1874624963095040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787782136.450814:0:17234:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:0.0:1787782136.451055:0:19601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787782136.451063:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.451076:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787782136.451081:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782136.451087:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.451114:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.451137:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.451144:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782136.451165:0:19601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787782136.451235:0:19601:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1787782136.451276:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17236:x1874624963094272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 116963us (117606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782136.451294:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782136.451325:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1874624963094272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787782136.451334:0:17236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787782136.451369:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1874624963095168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787782136.451399:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782136.451416:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d467eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782136.451428:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095168 00000100:00100000:0.0:1787782136.451433:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095168 00000100:00100000:0.0:1787782136.451464:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782136.451472:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17236:x1874624963095168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787782136.451501:0:19602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1787782136.452623:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782136.452632:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.452643:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782136.452648:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.452657:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.452685:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.452706:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315ddd3/0xc6d6745c15064914 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.452799:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.452802:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782136.452804:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782136.456678:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17236:x1874624963095168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5201us (5272us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787782136.456691:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782136.456773:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1874624963095168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787782136.456790:0:17236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 10000000:01000000:2.0:1787782136.519001:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787782136.519008:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993d67ccb800 from 10 10000000:01000000:2.0:1787782136.519013:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787782136.519061:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.519072:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782136.519083:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782136.519136:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782136.519205:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782136.519250:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d50316240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782136.519514:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095296 00000100:00100000:1.0:1787782136.519522:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095296 00000100:00100000:1.0:1787782136.519576:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787782136.519586:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963095296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782136.519601:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782136.519636:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfa200/0xc6d6745c15064922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c1506491b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.519661:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfa200/0xc6d6745c15064922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c1506491b expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.519672:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfa200/0xc6d6745c15064922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506491b expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.519682:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa200, rc 0) 00000100:00100000:1.0:1787782136.519725:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963095296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782136.519732:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787782136.519781:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782136.519796:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064922 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.519804:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064922 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782136.519850:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787782136.519878:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.519893:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782136.519906:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095424 00000100:00100000:1.0:1787782136.519909:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095424 00000100:00100000:1.0:1787782136.519934:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787782136.519940:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963095424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782136.519953:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782136.519967:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782136.519970:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787782136.520052:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963095424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782136.520059:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787782136.520087:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787782136.520150:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782136.520157:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064922 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520165:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d43039600/0xc6d6745c1506491b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064922 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782136.520184:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787782136.520186:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff993c4442b000 from 10 10000000:01000000:1.0:1787782136.520188:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787782136.520206:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520213:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520221:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782136.520233:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782136.520258:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.520270:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782136.520296:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095552 00000100:00100000:1.0:1787782136.520299:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095552 00000100:00100000:1.0:1787782136.520320:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787782136.520326:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963095552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782136.520333:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782136.520341:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfb200/0xc6d6745c15064930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c15064929 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520356:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb200/0xc6d6745c15064930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c15064929 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520363:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfb200/0xc6d6745c15064930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064929 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520381:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb200, rc 0) 00000100:00100000:1.0:1787782136.520410:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963095552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782136.520416:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787782136.520443:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782136.520452:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064930 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520459:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c15064930 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782136.520493:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787782136.520520:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782136.520532:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782136.520542:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095680 00000100:00100000:1.0:1787782136.520545:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095680 00000100:00100000:1.0:1787782136.520565:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787782136.520570:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963095680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782136.520580:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782136.520590:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782136.520592:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787782136.520673:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963095680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782136.520680:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787782136.520708:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963095680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787782136.520749:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782136.520754:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064930 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782136.520761:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfba00/0xc6d6745c15064929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c15064930 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782136.583862:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782137.225751:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782138.248258:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782139.269955:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782139.407669:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963095808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782139.407764:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782139.407885:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095808 00000100:00100000:1.0:1787782139.407896:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095808 00000100:00100000:1.0:1787782139.407968:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782139.407979:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963095808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782139.408013:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782139.408078:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963095808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782139.408086:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782139.408240:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963095808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787782139.408383:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787782140.294228:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782140.935864:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963095936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782140.935941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782140.935998:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782140.936005:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963096064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782140.936029:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782140.938006:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963095936 00000100:00100000:1.0:1787782140.938020:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963095936 00000100:00100000:1.0:1787782140.938155:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096064 00000100:00100000:1.0:1787782140.938159:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096064 00000100:00100000:1.0:1787782140.938180:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787782140.938190:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963095936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787782140.938229:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787782140.938369:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787782140.938379:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963096064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787782140.938398:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787782140.938454:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963095936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 265us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782140.938462:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787782140.941797:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963096064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3409us (5756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782140.941811:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787782140.945792:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963095936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782140.945840:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963096064:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787782141.319555:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782141.445937:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963096192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782141.446011:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.446057:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963096704:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782141.446116:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963096448:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446139:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963097216:0@lo:400:kworker.0 00000100:00100000:3.0:1787782141.446159:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.446171:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782141.446189:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963096960:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446198:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787782141.446207:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963096320:0@lo:400:kworker.0 00000100:00100000:3.0:1787782141.446218:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782141.446289:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096448 00000100:00100000:1.0:1787782141.446296:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096448 00000100:00100000:1.0:1787782141.446345:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096960 00000100:00100000:1.0:1787782141.446348:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096960 00000100:00100000:1.0:1787782141.446367:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782141.446375:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963096448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782141.446409:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963097472:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446806:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.446833:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963096832:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446856:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.446872:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963097344:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.446888:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.446921:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782141.446941:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.447006:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096192 00000100:00100000:0.0:1787782141.447010:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096192 00000100:00100000:0.0:1787782141.447030:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097728 00000100:00100000:0.0:1787782141.447033:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097728 00000100:00100000:0.0:1787782141.447047:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782141.447054:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963096192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782141.447074:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787782141.447517:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963096192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 462us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.447525:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782141.447542:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782141.447549:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963097728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782141.447752:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787782141.447786:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1874624963097728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 238us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.447792:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782141.447815:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096704 00000100:00100000:0.0:1787782141.447820:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096704 00000100:00100000:0.0:1787782141.447848:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097216 00000100:00100000:0.0:1787782141.447851:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097216 00000100:00100000:0.0:1787782141.447863:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097344 00000100:00100000:0.0:1787782141.447865:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097344 00000100:00100000:0.0:1787782141.447878:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782141.447884:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963096704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.447914:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963096704:12345-0@lo:400:kworker.0 Request processed in 31us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.447934:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782141.447946:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782141.447951:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963097216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.447979:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963097216:12345-0@lo:400:kworker.0 Request processed in 28us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.447985:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782141.447995:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787782141.448001:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.448025:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963097344:12345-0@lo:400:kworker.0 Request processed in 25us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.448031:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787782141.448051:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096832 00000100:00100000:0.0:1787782141.448055:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096832 00000100:00100000:0.0:1787782141.448072:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782141.448078:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963096960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.448396:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963096960:12345-0@lo:400:kworker.0 Request processed in 317us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.448403:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782141.448418:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782141.448426:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963096832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.448454:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963096832:12345-0@lo:400:kworker.0 Request processed in 30us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.448460:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782141.448482:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096320 00000100:00100000:0.0:1787782141.448486:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096320 00000100:00100000:0.0:1787782141.448530:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787782141.448536:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3657:x1874624963096320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.450355:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3657:x1874624963096320:12345-0@lo:400:kworker.0 Request processed in 1812us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.450367:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787782141.450453:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963097856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782141.450476:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963096576:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.450495:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782141.450529:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097856 00000100:00100000:0.0:1787782141.450534:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097856 00000100:00100000:2.0:1787782141.451039:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782141.451066:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963097088:0@lo:400:kworker.0 00000100:00100000:2.0:1787782141.451110:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782141.451136:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963097600:0@lo:400:kworker.0 00000100:00100000:2.0:1787782141.451166:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782141.451203:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963096576 00000100:00100000:2.0:1787782141.451207:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963096576 00000100:00100000:2.0:1787782141.452246:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782141.452267:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1874624963096576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782141.452340:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1874624963096576:12345-0@lo:400:kworker.0 Request processed in 79us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782141.452348:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782141.452417:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963096576:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.452433:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782141.452447:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963097856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787782141.452480:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787782141.452524:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963097856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.452531:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782141.452558:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097088 00000100:00100000:0.0:1787782141.452678:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097088 00000100:00100000:0.0:1787782141.452710:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097600 00000100:00100000:0.0:1787782141.452713:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097600 00000100:00100000:0.0:1787782141.452734:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782141.452740:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963097088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.452778:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963097088:12345-0@lo:400:kworker.0 Request processed in 38us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.452784:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782141.452795:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787782141.452801:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963097600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.452826:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963097600:12345-0@lo:400:kworker.0 Request processed in 25us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782141.452837:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787782141.452872:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ee1c0 x1874624963097088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782141.452883:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963097088:0@lo:400:kworker.0 00010000:00080000:0.0:1787782141.452893:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506eda40 x1874624963097600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782141.452901:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963097600:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.452932:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c431a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963097856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782141.452964:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782141.452975:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963096320:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.452986:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963096832:0@lo:400:kworker.0 00010000:00080000:0.0:1787782141.452997:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506efc00 x1874624963097344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782141.453005:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963097344:0@lo:400:kworker.0 00010000:00080000:0.0:1787782141.453016:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506eed00 x1874624963097216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782141.453023:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963097216:0@lo:400:kworker.0 00010000:00080000:0.0:1787782141.453033:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ec000 x1874624963096704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782141.453041:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963096704:0@lo:400:kworker.0 00000100:00100000:0.0:1787782141.453065:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963096192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787782141.453468:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787782141.453473:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782141.453477:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782141.453479:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782141.454075:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963096448:12345-0@lo:400:kworker.0 Request processed in 7697us (7912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782141.454087:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782141.464090:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782141.464190:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963096448:0@lo:400:kworker.0 00000100:00100000:3.0:1787782141.464205:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963096960:0@lo:400:kworker.0 00000100:00100000:1.0:1787782141.465415:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097472 00000100:00100000:1.0:1787782141.465425:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097472 00000100:00100000:1.0:1787782141.465506:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787782141.465516:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963097472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782141.465590:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874624963097472:12345-0@lo:400:kworker.0 Request processed in 76us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782141.465598:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787782141.467026:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787782141.467076:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d506ed2c0 x1874624963097472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782141.467107:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1874624963097472:0@lo:400:kworker.0 00000001:00080000:2.0:1787782141.963371:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1787782142.343258:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787782142.631487:0:19887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg616-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1787782142.982763:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782143.366958:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787782143.744919:0:19939:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787782143.746243:0:19939:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787782144.393047:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782144.518007:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963097984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787782144.518105:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782144.518456:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963097984 00000100:00100000:1.0:1787782144.518465:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963097984 00000100:00100000:1.0:1787782144.518520:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782144.518529:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963097984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782144.518560:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782144.518641:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963097984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782144.518648:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782144.518691:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963097984:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787782144.518850:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1787782144.703429:0:19989:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787782144.703919:0:19989:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787782145.016880:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.017022:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081856 00000100:00100000:0.0:1787782145.017042:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081856 00000100:00100000:0.0:1787782145.017098:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 115 00000100:00100000:0.0:1787782145.017107:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1874624943081856:12345-192.168.206.16@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787782145.017136:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a82bbaac-ff23-4e9c-aac0-3e7ff68d6307@192.168.206.16@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:0.0:1787782145.017169:0:17204:0:(genops.c:1385:class_connect()) connect: client a82bbaac-ff23-4e9c-aac0-3e7ff68d6307, cookie 0xc6d6745c15064937 00000100:00080000:0.0:1787782145.017304:0:17204:0:(import.c:65:import_set_state_nolock()) ffff993c43109800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782145.017389:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+5:2405:x1874624943081856:12345-192.168.206.16@tcp:250:mount.lustre.0 Request processed in 280us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.017397:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 115 00000100:00100000:0.0:1787782145.028820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.031505:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943081984 00000100:00100000:1.0:1787782145.031519:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943081984 00000100:00100000:1.0:1787782145.031575:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 116 00000100:00100000:1.0:1787782145.031585:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+5:14942:x1874624943081984:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782145.031601:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782145.031910:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfae00/0xc6d6745c1506493e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d6e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.031942:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfae00/0xc6d6745c1506493e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d6e expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.031953:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfae00/0xc6d6745c1506493e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d6e expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.031962:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfae00, rc 0) 00000100:00100000:1.0:1787782145.032218:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+6:14942:x1874624943081984:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 632us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.032226:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 116 00000100:00100000:2.0:1787782145.047599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.047753:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082112 00000100:00100000:1.0:1787782145.047763:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082112 00000100:00100000:1.0:1787782145.047819:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 117 00000100:00100000:1.0:1787782145.047829:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+6:14942:x1874624943082112:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787782145.047952:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+6:14942:x1874624943082112:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 124us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782145.047960:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 117 00000100:00100000:3.0:1787782145.051850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.052027:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082240 00000100:00100000:1.0:1787782145.052037:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082240 00000100:00100000:1.0:1787782145.052133:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 118 00000100:00100000:1.0:1787782145.052144:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+6:14942:x1874624943082240:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782145.052167:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782145.052188:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83d75 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.052223:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d75 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.052235:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfb400/0xc6d6745c15064945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83d75 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782145.052245:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb400, rc 0) 00000100:00100000:1.0:1787782145.052311:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+7:14942:x1874624943082240:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 169us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.052320:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 118 00000100:00100000:3.0:1787782145.054944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.055318:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082368 00000100:00100000:0.0:1787782145.055328:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082368 00000100:00100000:0.0:1787782145.055386:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 119 00000100:00100000:0.0:1787782145.055396:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+7:14942:x1874624943082368:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787782145.055556:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14942:x1874624943082368:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 161us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.055565:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 119 00000100:00100000:2.0:1787782145.060482:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.062229:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082496 00000100:00100000:0.0:1787782145.062244:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082496 00000100:00100000:0.0:1787782145.062333:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 120 00000100:00100000:0.0:1787782145.062344:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14942:x1874624943082496:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787782145.063996:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14942:x1874624943082496:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 1643us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.064009:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 120 00000100:00100000:0.0:1787782145.094978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782145.095169:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082624 00000100:00100000:3.0:1787782145.095178:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082624 00000100:00100000:3.0:1787782145.095246:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:3.0:1787782145.095259:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082624:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782145.095422:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082624:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 165us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782145.095433:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 121 00000100:00100000:2.0:1787782145.137379:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.137479:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082752 00000100:00100000:0.0:1787782145.137488:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082752 00000100:00100000:0.0:1787782145.137548:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00100000:0.0:1787782145.137558:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082752:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782145.137762:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082752:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 204us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.137771:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 122 00000100:00100000:2.0:1787782145.141030:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.141199:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943082880 00000100:00100000:0.0:1787782145.141208:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943082880 00000100:00100000:0.0:1787782145.141266:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 123 00000100:00100000:0.0:1787782145.141277:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082880:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782145.141414:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14960:x1874624943082880:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.141422:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 123 00000100:00100000:2.0:1787782145.146048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782145.146205:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083008 00000100:00100000:3.0:1787782145.146215:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083008 00000100:00100000:3.0:1787782145.146270:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 124 00000100:00100000:3.0:1787782145.146280:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+8:14942:x1874624943083008:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782145.146296:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782145.146314:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705600/0xc6d6745c1506494c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83da6 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782145.146342:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705600/0xc6d6745c1506494c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83da6 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782145.146353:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705600/0xc6d6745c1506494c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83da6 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782145.146380:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705600, rc 0) 00000100:00100000:3.0:1787782145.146441:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+9:14942:x1874624943083008:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782145.146449:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 124 00000100:00100000:2.0:1787782145.160183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.160334:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083136 00000100:00100000:1.0:1787782145.160346:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083136 00000100:00100000:1.0:1787782145.160401:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 125 00000100:00100000:1.0:1787782145.160412:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+9:14942:x1874624943083136:12345-192.168.206.16@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787782145.160435:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787782145.160461:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787782145.160465:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787782145.160469:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787782145.160472:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787782145.160474:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787782145.175597:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+9:14942:x1874624943083136:12345-192.168.206.16@tcp:256:mount.lustre.0 Request processed in 15174us (15411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.176224:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 125 00000100:00100000:2.0:1787782145.184447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.184556:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083264 00000100:00100000:0.0:1787782145.184569:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083264 00000100:00100000:0.0:1787782145.184691:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 126 00000100:00100000:0.0:1787782145.184701:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+9:14942:x1874624943083264:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787782145.184720:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782145.184737:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83dad expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.184768:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.184779:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.184787:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8c00, rc 0) 00000100:00100000:0.0:1787782145.184837:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14942:x1874624943083264:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 137us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.184844:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 126 00000100:00100000:2.0:1787782145.199382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.199836:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083392 00000100:00100000:0.0:1787782145.199846:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083392 00000100:00100000:0.0:1787782145.199910:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 127 00000100:00100000:0.0:1787782145.199920:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d46fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14942:x1874624943083392:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787782145.200180:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d46fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14942:x1874624943083392:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 260us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.200188:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 127 00000100:00100000:1.0:1787782145.208958:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782145.209266:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083520 00000100:00100000:3.0:1787782145.209275:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083520 00000100:00100000:3.0:1787782145.209330:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 128 00000100:00100000:3.0:1787782145.209341:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14942:x1874624943083520:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787782145.209485:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14942:x1874624943083520:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 144us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782145.209493:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 128 00000100:00100000:2.0:1787782145.215198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782145.215301:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083648 00000100:00100000:3.0:1787782145.215311:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083648 00000100:00100000:3.0:1787782145.215428:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:3.0:1787782145.215439:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14966:x1874624943083648:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782145.215597:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14966:x1874624943083648:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782145.215647:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 129 00000100:00100000:2.0:1787782145.232836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.233021:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083776 00000100:00100000:0.0:1787782145.233030:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083776 00000100:00100000:0.0:1787782145.233094:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00100000:0.0:1787782145.233105:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14966:x1874624943083776:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782145.233265:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:14966:x1874624943083776:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 161us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.233272:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 130 00000100:00100000:2.0:1787782145.248715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782145.248804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.248976:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943083904 00000100:00100000:1.0:1787782145.248997:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943083904 00000100:00100000:1.0:1787782145.249036:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084160 00000100:00100000:1.0:1787782145.249039:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084160 00000100:00100000:1.0:1787782145.249069:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:1.0:1787782145.249088:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1874624943083904:12345-192.168.206.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787782145.249117:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2e9e9e90-3be8-496e-9d8c-b3039adccc53@192.168.206.16@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:1.0:1787782145.249163:0:17209:0:(genops.c:1385:class_connect()) connect: client 2e9e9e90-3be8-496e-9d8c-b3039adccc53, cookie 0xc6d6745c1506495a 00000004:00100000:1.0:1787782145.249189:0:17209:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787782145.249448:0:17209:0:(import.c:65:import_set_state_nolock()) ffff993d77c18000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782145.249520:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2405:x1874624943083904:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 431us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.249527:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:1.0:1787782145.249546:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:1.0:1787782145.249550:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1874624943084160:12345-192.168.206.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787782145.249565:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2e9e9e90-3be8-496e-9d8c-b3039adccc53@192.168.206.16@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:1.0:1787782145.249594:0:17209:0:(genops.c:1385:class_connect()) connect: client 2e9e9e90-3be8-496e-9d8c-b3039adccc53, cookie 0xc6d6745c15064961 00000004:00100000:1.0:1787782145.249638:0:17209:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787782145.249784:0:17209:0:(import.c:65:import_set_state_nolock()) ffff993d77c1f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782145.249811:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2405:x1874624943084160:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 259us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.249818:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:2.0:1787782145.261028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782145.261070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782145.261111:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.264270:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084416 00000100:00100000:0.0:1787782145.264284:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084416 00000100:00100000:0.0:1787782145.264373:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084032 00000100:00100000:0.0:1787782145.264377:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084032 00000100:00100000:0.0:1787782145.264390:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084288 00000100:00100000:0.0:1787782145.264392:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084288 00000100:00100000:0.0:1787782145.264416:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787782145.264426:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:14942:x1874624943084416:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787782145.264466:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782145.264563:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:14942:x1874624943084416:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 139us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.264571:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787782145.264590:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:0.0:1787782145.264596:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:0:x1874624943084032:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787782145.264625:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782145.264663:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:0:x1874624943084032:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 67us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.264670:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:0.0:1787782145.264694:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:0.0:1787782145.264701:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:0:x1874624943084288:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787782145.264718:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787782145.264756:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:0:x1874624943084288:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 55us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.264777:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00080000:2.0:1787782145.265649:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787782145.265657:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782145.268206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.268357:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084544 00000100:00100000:0.0:1787782145.268366:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084544 00000100:00100000:0.0:1787782145.268436:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:0.0:1787782145.268445:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14942:x1874624943084544:12345-192.168.206.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787782145.268539:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14942:x1874624943084544:12345-192.168.206.16@tcp:40:mount.lustre.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.268547:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:0.0:1787782145.279260:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.279304:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.279342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782145.279434:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084672 00000100:00100000:1.0:1787782145.279443:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084672 00000100:00100000:1.0:1787782145.279482:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084800 00000100:00100000:1.0:1787782145.279486:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084800 00000100:00100000:1.0:1787782145.279503:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787782145.279536:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2405:x1874624943084672:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787782145.279567:0:19602:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e9e9e90-3be8-496e-9d8c-b3039adccc53@192.168.206.16@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:1.0:1787782145.279596:0:19602:0:(genops.c:1385:class_connect()) connect: client 2e9e9e90-3be8-496e-9d8c-b3039adccc53, cookie 0xc6d6745c15064968 00002000:00100000:1.0:1787782145.279644:0:19602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e9e9e90-3be8-496e-9d8c-b3039adccc53/ffff993d77c19800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787782145.279656:0:19602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787782145.279860:0:19602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787782145.279895:0:19602:0:(import.c:65:import_set_state_nolock()) ffff993d77c1a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782145.279959:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2405:x1874624943084672:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 423us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.279968:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787782145.279986:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:1.0:1787782145.279990:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2405:x1874624943084800:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787782145.280008:0:19602:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2e9e9e90-3be8-496e-9d8c-b3039adccc53@192.168.206.16@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:1.0:1787782145.280026:0:19602:0:(genops.c:1385:class_connect()) connect: client 2e9e9e90-3be8-496e-9d8c-b3039adccc53, cookie 0xc6d6745c1506496f 00002000:00100000:1.0:1787782145.280031:0:19602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e9e9e90-3be8-496e-9d8c-b3039adccc53/ffff993d49358000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787782145.280044:0:19602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787782145.280186:0:19602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787782145.280202:0:19602:0:(import.c:65:import_set_state_nolock()) ffff993d4935d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782145.280229:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2405:x1874624943084800:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 236us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.280236:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:2.0:1787782145.280940:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943084928 00000100:00100000:2.0:1787782145.280949:0:17221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943084928 00000100:00100000:2.0:1787782145.280992:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:2.0:1787782145.281000:0:17221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14942:x1874624943084928:12345-192.168.206.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787782145.281053:0:17221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14942:x1874624943084928:12345-192.168.206.16@tcp:900:mount.lustre.0 Request processed in 54us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782145.281059:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:0.0:1787782145.284129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.284170:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.284206:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.284240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.284262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.284292:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085568 00000100:00100000:0.0:1787782145.284301:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085568 00000100:00100000:0.0:1787782145.284349:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085440 00000100:00100000:0.0:1787782145.284353:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085440 00000100:00100000:0.0:1787782145.284378:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:0.0:1787782145.284388:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2407:x1874624943085568:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782145.284454:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2407:x1874624943085568:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.284462:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:0.0:1787782145.284478:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:0.0:1787782145.284502:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2406:x1874624943085440:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782145.284543:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2406:x1874624943085440:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.284549:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:3.0:1787782145.284831:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085056 00000100:00100000:3.0:1787782145.284837:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085056 00000100:00100000:3.0:1787782145.284868:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 131 00000100:00100000:3.0:1787782145.284876:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:2407:x1874624943085056:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782145.284950:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085312 00000100:00100000:1.0:1787782145.284955:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085312 00000100:00100000:1.0:1787782145.284982:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085184 00000100:00100000:1.0:1787782145.284991:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085184 00000100:00100000:1.0:1787782145.285013:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:1.0:1787782145.285020:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2407:x1874624943085312:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782145.285103:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:2.0:1787782145.285113:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2406:x1874624943085184:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:3.0:1787782145.288340:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:2407:x1874624943085056:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 3452us (4208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782145.288369:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 131 00000100:00100000:0.0:1787782145.288594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.288914:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085696 00000100:00100000:0.0:1787782145.288922:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085696 00000100:00100000:0.0:1787782145.288960:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:0.0:1787782145.288969:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:14942:x1874624943085696:12345-192.168.206.16@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787782145.289963:0:17212:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 919us 00000100:00080000:3.0:1787782145.293001:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782145.293010:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782145.295173:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2407:x1874624943085312:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 10142us (10992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782145.295188:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:2.0:1787782145.299919:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2406:x1874624943085184:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 14797us (15700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782145.299935:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00000004:00200000:0.0:1787782145.306953:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787782145.307062:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14942:x1874624943085696:12345-192.168.206.16@tcp:33:mount.lustre.0 Request processed in 18088us (18464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.307085:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00010000:00010000:1.0:1787782145.415467:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782145.475903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782145.476089:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085824 00000100:00100000:0.0:1787782145.476102:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085824 00000100:00100000:0.0:1787782145.476178:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787782145.476190:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:14989:x1874624943085824:12345-192.168.206.16@tcp:101:mkdir.0 00010000:00010000:0.0:1787782145.476216:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782145.476261:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83dde expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476343:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476359:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476395:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782145.476456:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787782145.476461:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787782145.476504:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476535:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dde expref: 8 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476557:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dde expref: 7 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782145.476566:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:0.0:1787782145.476569:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782145.476573:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9200, rc 0) 00000100:00100000:0.0:1787782145.476939:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:14989:x1874624943085824:12345-192.168.206.16@tcp:101:mkdir.0 Request processed in 750us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782145.476948:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:2.0:1787782146.057125:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782146.057157:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963098112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787782146.057263:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782146.057362:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098112 00000100:00100000:2.0:1787782146.057371:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098112 00000100:00100000:2.0:1787782146.057427:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787782146.057442:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963098112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787782146.057485:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787782146.057537:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963098112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.057719:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963098112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782146.057755:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963098240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787782146.057789:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782146.057831:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098240 00000100:00100000:3.0:1787782146.057835:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098240 00000100:00100000:2.0:1787782146.062340:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782146.064414:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787782146.064445:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963098240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787782146.064500:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782146.064636:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963098240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (6845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.064645:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787782146.064754:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963098240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787782146.438623:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782146.566278:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782146.566305:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963098368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782146.566390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782146.566447:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098368 00000100:00100000:0.0:1787782146.566454:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098368 00000100:00100000:0.0:1787782146.566514:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782146.566523:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963098368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782146.566572:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787782146.566644:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963098368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782146.566653:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782146.566713:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787782146.566740:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963098368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782146.566855:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782146.566867:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963098496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782146.566900:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782146.566928:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098496 00000100:00100000:2.0:1787782146.566932:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098496 00000100:00100000:2.0:1787782146.566958:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782146.566965:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963098496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787782146.566975:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787782146.567004:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963098496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782146.567010:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782146.567043:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963098496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782146.567243:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963098624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782146.567271:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782146.567338:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098624 00000100:00100000:1.0:1787782146.567343:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098624 00000100:00100000:1.0:1787782146.567378:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782146.567385:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963098624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782146.567407:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782146.567445:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963098624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782146.567452:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782146.567483:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963098624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787782146.567892:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782146.567898:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782146.568303:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963099136:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568349:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782146.568378:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963099648:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568400:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782146.568418:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782146.568423:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963099008:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568449:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782146.568468:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963099520:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568492:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782146.568522:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099136 00000100:00100000:0.0:1787782146.568526:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099136 00000100:00100000:0.0:1787782146.568567:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099648 00000100:00100000:0.0:1787782146.568570:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099648 00000100:00100000:0.0:1787782146.568588:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099520 00000100:00100000:0.0:1787782146.568591:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099520 00000100:00100000:0.0:1787782146.568647:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787782146.568657:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963099136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568711:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963099136:12345-0@lo:400:kworker.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782146.568718:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787782146.568756:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787782146.568762:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963099648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568791:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963099648:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782146.568797:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787782146.568807:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787782146.568812:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963099520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568835:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963099520:12345-0@lo:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782146.568840:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787782146.568855:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099008 00000100:00100000:0.0:1787782146.568858:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099008 00000100:00100000:0.0:1787782146.568883:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782146.568889:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963099008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568913:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963099008:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782146.568919:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782146.568949:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963099008:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568959:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963099520:0@lo:400:kworker.0 00000100:00100000:0.0:1787782146.568968:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963099136:0@lo:400:kworker.0 00010000:00080000:0.0:1787782146.568979:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ed52c0 x1874624963099648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782146.568990:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963099648:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569524:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963098880:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569564:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782146.569595:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963099392:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569661:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782146.569693:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787782146.569700:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963098752:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569730:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782146.569760:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963099264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569796:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782146.569822:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098752 00000100:00100000:3.0:1787782146.569826:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098752 00000100:00100000:3.0:1787782146.569863:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787782146.569870:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3658:x1874624963098752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569909:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3658:x1874624963098752:12345-0@lo:400:kworker.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.569915:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787782146.569945:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782146.569951:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787782146.569953:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787782146.569971:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963098752:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.569988:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963098880 00000100:00100000:3.0:1787782146.569990:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963098880 00000100:00100000:3.0:1787782146.570005:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099392 00000100:00100000:3.0:1787782146.570007:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099392 00000100:00100000:3.0:1787782146.570021:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099264 00000100:00100000:3.0:1787782146.570023:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099264 00000100:00100000:3.0:1787782146.570035:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782146.570039:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.570080:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874624963098880:12345-0@lo:400:kworker.0 Request processed in 40us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.570086:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782146.570096:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787782146.570101:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.570124:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963099392:12345-0@lo:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.570138:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787782146.570148:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782146.570152:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963099264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.570174:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963099264:12345-0@lo:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782146.570178:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787782146.570189:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787782146.570191:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787782146.570204:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963099264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782146.570214:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874624963098880:0@lo:400:kworker.0 00010000:00080000:3.0:1787782146.570223:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43ed7480 x1874624963099392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782146.570234:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963099392:0@lo:400:kworker.0 00000040:00080000:0.0:1787782146.822767:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782147.465098:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782147.624885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782147.627701:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943085952 00000100:00100000:0.0:1787782147.627716:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943085952 00000100:00100000:0.0:1787782147.627804:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:0.0:1787782147.627814:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15042:x1874624943085952:12345-192.168.206.16@tcp:41:lfs.0 00000004:00000024:0.0:1787782147.627852:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782147.627958:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15042:x1874624943085952:12345-192.168.206.16@tcp:41:lfs.0 Request processed in 146us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782147.627966:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00080000:3.0:1787782147.628698:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782147.633882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782147.634544:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086080 00000100:00100000:0.0:1787782147.634556:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086080 00000100:00100000:0.0:1787782147.634678:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:0.0:1787782147.634689:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086080:12345-192.168.206.16@tcp:41:lfs.0 00000004:00000024:0.0:1787782147.634724:0:18983:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787782147.634817:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086080:12345-192.168.206.16@tcp:41:lfs.0 Request processed in 130us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782147.634825:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00080000:3.0:1787782147.635269:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787782147.643734:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782147.644159:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086208 00000100:00100000:1.0:1787782147.644187:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086208 00000100:00100000:1.0:1787782147.644275:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:1.0:1787782147.644288:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086208:12345-192.168.206.16@tcp:13:lfs.0 00002000:00000024:1.0:1787782147.644329:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782147.644450:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086208:12345-192.168.206.16@tcp:13:lfs.0 Request processed in 165us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782147.644470:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00080000:3.0:1787782147.644788:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782147.656895:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782147.657032:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086336 00000100:00100000:2.0:1787782147.657046:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086336 00000100:00100000:2.0:1787782147.657153:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:2.0:1787782147.657167:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086336:12345-192.168.206.16@tcp:13:lfs.0 00002000:00000024:2.0:1787782147.657232:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787782147.657362:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15042:x1874624943086336:12345-192.168.206.16@tcp:13:lfs.0 Request processed in 198us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782147.657371:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00080000:3.0:1787782147.657443:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782147.883124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782147.883233:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086464 00000100:00100000:3.0:1787782147.883247:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086464 00000100:00100000:3.0:1787782147.883324:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 133 00000100:00100000:3.0:1787782147.883335:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+10:15074:x1874624943086464:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782147.883357:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782147.883379:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705e00/0xc6d6745c15064984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83de5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782147.883438:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705e00/0xc6d6745c15064984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83de5 expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782147.883451:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705e00/0xc6d6745c15064984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83de5 expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782147.883461:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705e00, rc 0) 00000100:00100000:3.0:1787782147.883537:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943086464:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 204us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782147.883545:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 133 00000100:00100000:1.0:1787782147.890068:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782147.890275:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086592 00000100:00100000:3.0:1787782147.890289:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086592 00000100:00100000:3.0:1787782147.890366:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 134 00000100:00100000:3.0:1787782147.890378:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943086592:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787782147.890599:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943086592:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 223us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782147.890654:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 134 00000100:00100000:0.0:1787782147.905171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782147.905416:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086720 00000100:00100000:1.0:1787782147.905433:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086720 00000100:00100000:1.0:1787782147.905535:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 135 00000100:00100000:1.0:1787782147.905548:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943086720:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782147.906026:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943086720:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 479us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782147.906046:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 135 00000100:00100000:1.0:1787782147.923545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782147.926269:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086848 00000100:00100000:0.0:1787782147.926291:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086848 00000100:00100000:0.0:1787782147.926384:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 136 00000100:00100000:0.0:1787782147.926398:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943086848:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782147.926669:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943086848:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 272us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782147.926678:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 136 00000100:00100000:2.0:1787782147.969079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782147.969275:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943086976 00000100:00100000:1.0:1787782147.969295:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943086976 00000100:00100000:1.0:1787782147.969391:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:1.0:1787782147.969404:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943086976:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782147.969698:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943086976:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 296us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782147.969708:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 137 00000100:00100000:1.0:1787782147.984235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782147.992598:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087104 00000100:00100000:3.0:1787782147.994728:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087104 00000100:00100000:3.0:1787782147.994843:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:3.0:1787782147.994856:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943087104:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782147.995088:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15081:x1874624943087104:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 234us (10874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782147.995098:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 138 00000100:00100000:2.0:1787782148.002817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782148.002924:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087232 00000100:00100000:3.0:1787782148.002954:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087232 00000100:00100000:3.0:1787782148.003041:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:3.0:1787782148.003054:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:15074:x1874624943087232:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782148.003085:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782148.003110:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43705000/0xc6d6745c1506498b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e16 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782148.003150:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43705000/0xc6d6745c1506498b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e16 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782148.003164:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43705000/0xc6d6745c1506498b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e16 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782148.003369:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705000, rc 0) 00000100:00100000:3.0:1787782148.003506:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:15074:x1874624943087232:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 454us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782148.003515:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 139 00000100:00100000:2.0:1787782148.008604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782148.008862:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087360 00000100:00100000:1.0:1787782148.008875:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087360 00000100:00100000:1.0:1787782148.008949:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:1.0:1787782148.008960:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:15074:x1874624943087360:12345-192.168.206.16@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787782148.008998:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787782148.009157:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787782148.009171:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787782148.009307:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787782148.009310:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787782148.009312:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787782148.020042:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:15074:x1874624943087360:12345-192.168.206.16@tcp:256:mount.lustre.0 Request processed in 11066us (11437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782148.020074:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 140 00000100:00100000:2.0:1787782148.033694:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.040067:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087488 00000100:00100000:0.0:1787782148.040090:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087488 00000100:00100000:0.0:1787782148.040196:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 141 00000100:00100000:0.0:1787782148.040209:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:15074:x1874624943087488:12345-192.168.206.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787782148.040233:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782148.040259:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e1d expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.040698:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.040715:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.040726:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8400, rc 0) 00000100:00100000:0.0:1787782148.040882:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15074:x1874624943087488:12345-192.168.206.16@tcp:101:mount.lustre.0 Request processed in 667us (7195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.040892:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 141 00000100:00100000:1.0:1787782148.046974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782148.047379:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087616 00000100:00100000:2.0:1787782148.047395:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087616 00000100:00100000:2.0:1787782148.047513:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 142 00000100:00100000:2.0:1787782148.047524:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15074:x1874624943087616:12345-192.168.206.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787782148.047771:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15074:x1874624943087616:12345-192.168.206.16@tcp:501:mount.lustre.0 Request processed in 248us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782148.047780:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 142 00000100:00100000:2.0:1787782148.060834:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.060950:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087744 00000100:00100000:0.0:1787782148.060963:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087744 00000100:00100000:0.0:1787782148.061082:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 143 00000100:00100000:0.0:1787782148.061094:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15074:x1874624943087744:12345-192.168.206.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787782148.061321:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15074:x1874624943087744:12345-192.168.206.16@tcp:503:mount.lustre.0 Request processed in 228us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.061330:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 143 00000100:00100000:1.0:1787782148.089401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782148.091883:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943087872 00000100:00100000:2.0:1787782148.091906:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943087872 00000100:00100000:2.0:1787782148.091989:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 144 00000100:00100000:2.0:1787782148.092002:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15085:x1874624943087872:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782148.092268:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15085:x1874624943087872:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 267us (2882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782148.092278:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 144 00000100:00100000:1.0:1787782148.096727:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.099256:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088000 00000100:00100000:0.0:1787782148.099281:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088000 00000100:00100000:0.0:1787782148.099414:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00100000:1.0:1787782148.099501:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15085:x1874624943088000:12345-192.168.206.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782148.100091:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:15085:x1874624943088000:12345-192.168.206.16@tcp:502:llog_process_th.0 Request processed in 665us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782148.100101:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 145 00000100:00100000:1.0:1787782148.112317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782148.112426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782148.112577:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088128 00000100:00100000:3.0:1787782148.112590:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088128 00000100:00100000:3.0:1787782148.112674:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088384 00000100:00100000:3.0:1787782148.112678:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088384 00000100:00100000:3.0:1787782148.112702:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:3.0:1787782148.112712:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1874624943088128:12345-192.168.206.16@tcp:38:mount.lustre.0 00000100:00100000:0.0:1787782148.112733:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:0.0:1787782148.112742:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1874624943088384:12345-192.168.206.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787782148.112753:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a0e00f26-a408-40f6-8a81-b71e91755e01@192.168.206.16@tcp t0 exp 0000000000000000 cur 585 last 0 00010000:00080000:0.0:1787782148.112766:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a0e00f26-a408-40f6-8a81-b71e91755e01@192.168.206.16@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:3.0:1787782148.112805:0:17211:0:(genops.c:1385:class_connect()) connect: client a0e00f26-a408-40f6-8a81-b71e91755e01, cookie 0xc6d6745c15064999 00000020:00000080:0.0:1787782148.112820:0:17209:0:(genops.c:1385:class_connect()) connect: client a0e00f26-a408-40f6-8a81-b71e91755e01, cookie 0xc6d6745c150649a0 00000004:00100000:3.0:1787782148.112843:0:17211:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1787782148.112844:0:17209:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787782148.112972:0:17209:0:(import.c:65:import_set_state_nolock()) ffff993d4461a800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787782148.114591:0:17211:0:(import.c:65:import_set_state_nolock()) ffff993d6ce13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782148.114852:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2405:x1874624943088128:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 2133us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782148.114866:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:1.0:1787782148.117275:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2405:x1874624943088384:12345-192.168.206.16@tcp:38:mount.lustre.0 Request processed in 4515us (4832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782148.117293:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787782148.121415:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782148.121474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.121573:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088256 00000100:00100000:0.0:1787782148.121586:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088256 00000100:00080000:3.0:1787782148.121712:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782148.121728:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088640 00000100:00100000:0.0:1787782148.121733:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088640 00000100:00100000:0.0:1787782148.121776:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787782148.121787:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+7:0:x1874624943088256:12345-192.168.206.16@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787782148.121823:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000004:00000024:0.0:1787782148.121838:0:18983:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787782148.121857:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+7:15074:x1874624943088640:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787782148.121910:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787782148.121935:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+7:0:x1874624943088256:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 148us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.121944:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:3.0:1787782148.121951:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+7:15074:x1874624943088640:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782148.121961:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787782148.127029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782148.127095:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782148.127208:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088512 00000100:00100000:3.0:1787782148.127221:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088512 00000100:00100000:0.0:1787782148.127292:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088768 00000100:00100000:0.0:1787782148.127298:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088768 00000100:00100000:0.0:1787782148.127370:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:0.0:1787782148.127381:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943088768:12345-192.168.206.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787782148.127498:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943088768:12345-192.168.206.16@tcp:40:mount.lustre.0 Request processed in 118us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.127507:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:3.0:1787782148.127886:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:3.0:1787782148.127896:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+6:0:x1874624943088512:12345-192.168.206.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787782148.127934:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782148.127996:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+6:0:x1874624943088512:12345-192.168.206.16@tcp:41:mount.lustre.0 Request processed in 102us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782148.128004:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00080000:0.0:1787782148.128015:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787782148.140208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782148.140255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782148.140295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782148.140461:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943088896 00000100:00100000:3.0:1787782148.140474:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943088896 00000100:00100000:3.0:1787782148.140521:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089024 00000100:00100000:3.0:1787782148.140523:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089024 00000100:00100000:3.0:1787782148.140540:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:3.0:1787782148.140550:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1874624943088896:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787782148.140595:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a0e00f26-a408-40f6-8a81-b71e91755e01@192.168.206.16@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:3.0:1787782148.140664:0:18717:0:(genops.c:1385:class_connect()) connect: client a0e00f26-a408-40f6-8a81-b71e91755e01, cookie 0xc6d6745c150649a7 00002000:00100000:3.0:1787782148.140679:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a0e00f26-a408-40f6-8a81-b71e91755e01/ffff993d6ce14000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782148.140701:0:18717:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787782148.140713:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089152 00000100:00100000:0.0:1787782148.140737:0:17221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089152 00000100:00100000:0.0:1787782148.140787:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787782148.140797:0:17221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943089152:12345-192.168.206.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787782148.140810:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:2.0:1787782148.140818:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1874624943089024:12345-192.168.206.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787782148.140839:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a0e00f26-a408-40f6-8a81-b71e91755e01@192.168.206.16@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:2.0:1787782148.140869:0:18716:0:(genops.c:1385:class_connect()) connect: client a0e00f26-a408-40f6-8a81-b71e91755e01, cookie 0xc6d6745c150649ae 00002000:00100000:2.0:1787782148.140874:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a0e00f26-a408-40f6-8a81-b71e91755e01/ffff993c4338e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782148.140881:0:18716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787782148.140983:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787782148.141015:0:18716:0:(import.c:65:import_set_state_nolock()) ffff993c4338c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782148.141029:0:17221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943089152:12345-192.168.206.16@tcp:900:mount.lustre.0 Request processed in 232us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.141039:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:2.0:1787782148.141048:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2405:x1874624943089024:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 228us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782148.141067:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00002000:00080000:3.0:1787782148.142492:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782148.142534:0:18717:0:(import.c:65:import_set_state_nolock()) ffff993d6ce12000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782148.142649:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2405:x1874624943088896:12345-192.168.206.16@tcp:8:mount.lustre.0 Request processed in 2097us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782148.142661:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787782148.152902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.153142:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089280 00000100:00100000:0.0:1787782148.153154:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089280 00000100:00100000:0.0:1787782148.153229:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:0.0:1787782148.153240:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943089280:12345-192.168.206.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787782148.153353:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787782148.153464:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15074:x1874624943089280:12345-192.168.206.16@tcp:33:mount.lustre.0 Request processed in 224us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.153472:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:1.0:1787782148.429161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782148.429410:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089408 00000100:00100000:0.0:1787782148.429424:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089408 00000100:00100000:0.0:1787782148.429512:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:0.0:1787782148.429525:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15108:x1874624943089408:12345-192.168.206.16@tcp:101:mkdir.0 00010000:00010000:0.0:1787782148.429553:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782148.429581:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150649b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e4e expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429734:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429752:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429794:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782148.429857:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787782148.429861:0:18983:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787782148.429887:0:18983:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429918:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c150649b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 8 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429938:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 7 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782148.429947:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:0.0:1787782148.429950:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782148.429954:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9000, rc 0) 00000100:00100000:0.0:1787782148.430039:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+7:15108:x1874624943089408:12345-192.168.206.16@tcp:101:mkdir.0 Request processed in 516us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782148.430047:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00010000:00010000:1.0:1787782148.485992:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782149.510862:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782149.637925:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782149.637965:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963099776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787782149.638078:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782149.638199:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099776 00000100:00100000:1.0:1787782149.638209:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099776 00000100:00100000:1.0:1787782149.638298:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782149.638330:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963099776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782149.638365:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782149.638435:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963099776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782149.638460:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782149.638562:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963099776:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787782149.638879:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787782150.534861:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782150.666551:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0e00f26-a408-40f6-8a81-b71e91755e01 00000001:00100000:0.0:1787782150.666567:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e9e9e90-3be8-496e-9d8c-b3039adccc53 00000001:00100000:1.0:1787782150.667130:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0e00f26-a408-40f6-8a81-b71e91755e01 00000001:00100000:1.0:1787782150.667138:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e9e9e90-3be8-496e-9d8c-b3039adccc53 00000001:00100000:3.0:1787782150.673425:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0e00f26-a408-40f6-8a81-b71e91755e01 00000001:00100000:3.0:1787782150.673437:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e9e9e90-3be8-496e-9d8c-b3039adccc53 00000001:00100000:2.0:1787782150.676651:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0e00f26-a408-40f6-8a81-b71e91755e01 00000001:00100000:2.0:1787782150.676668:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e9e9e90-3be8-496e-9d8c-b3039adccc53 00000100:00100000:3.0:1787782151.173900:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963099904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787782151.173972:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782151.174142:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963099904 00000100:00100000:2.0:1787782151.174150:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963099904 00000100:00100000:2.0:1787782151.174198:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787782151.174208:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963099904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787782151.174241:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787782151.174285:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963099904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782151.174292:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782151.174437:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963099904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787782151.176108:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963100032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782151.176165:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782151.176369:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100032 00000100:00100000:3.0:1787782151.176376:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100032 00000100:00100000:3.0:1787782151.176425:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782151.176433:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963100032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787782151.176461:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782151.176922:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963100032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 487us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782151.176930:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787782151.181450:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963100032:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787782151.559011:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782151.693817:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782151.693840:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963100160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782151.693909:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782151.693967:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100160 00000100:00100000:0.0:1787782151.693973:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100160 00000100:00100000:0.0:1787782151.694019:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782151.694027:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963100160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782151.694063:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787782151.694119:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963100160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782151.694125:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787782151.694143:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782151.694174:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963100160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782151.695306:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963100288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782151.695353:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782151.695450:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100288 00000100:00100000:1.0:1787782151.695457:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100288 00000100:00100000:1.0:1787782151.695494:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782151.695502:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963100288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787782151.695524:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787782151.703776:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963100288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8264us (8412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782151.703790:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782151.704724:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963100416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782151.704792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782151.705013:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782151.705029:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100416 00000100:00100000:1.0:1787782151.705051:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100416 00000100:00100000:1.0:1787782151.705099:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787782151.705108:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963100416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782151.705131:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787782151.705171:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963100416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782151.705195:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782151.705518:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963100672:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705553:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782151.705575:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963101184:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705594:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782151.705636:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787782151.705642:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963100544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705674:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782151.705698:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963101056:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705718:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782151.705743:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100672 00000100:00100000:3.0:1787782151.705747:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100672 00000100:00100000:3.0:1787782151.705775:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101184 00000100:00100000:3.0:1787782151.705778:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101184 00000100:00100000:3.0:1787782151.705791:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101056 00000100:00100000:3.0:1787782151.705793:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101056 00000100:00100000:3.0:1787782151.705889:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782151.705897:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705940:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963100672:12345-0@lo:400:kworker.0 Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782151.705946:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782151.705960:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782151.705966:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963101184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.705991:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874624963101184:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782151.705996:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782151.706005:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787782151.706010:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963101056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.706030:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874624963101056:12345-0@lo:400:kworker.0 Request processed in 20us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782151.706035:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787782151.706067:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100544 00000100:00100000:3.0:1787782151.706075:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100544 00000100:00100000:3.0:1787782151.706101:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787782151.706107:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3660:x1874624963100544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.706134:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3660:x1874624963100544:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782151.706139:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787782151.706331:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963100928:0@lo:400:kworker.0 00000100:00100000:1.0:1787782151.706503:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782151.706524:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963101440:0@lo:400:kworker.0 00000100:00100000:1.0:1787782151.706543:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782151.706574:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963100416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782151.706671:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787782151.706678:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963100800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782151.706702:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782151.706720:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963101312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782151.706736:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782151.706753:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782151.706757:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787782151.706760:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782151.706844:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100928 00000100:00100000:0.0:1787782151.706849:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100928 00000100:00100000:0.0:1787782151.706871:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101440 00000100:00100000:0.0:1787782151.706874:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101440 00000100:00100000:0.0:1787782151.706888:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101312 00000100:00100000:0.0:1787782151.706891:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101312 00000100:00100000:0.0:1787782151.706904:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782151.706910:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963100928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782151.706951:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874624963100928:12345-0@lo:400:kworker.0 Request processed in 41us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782151.706957:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782151.706969:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782151.706974:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963101440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782151.706999:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874624963101440:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782151.707005:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782151.707015:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782151.707021:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963101312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782151.707070:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874624963101312:12345-0@lo:400:kworker.0 Request processed in 49us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782151.707076:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782151.707094:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963100800 00000100:00100000:0.0:1787782151.707098:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963100800 00000100:00100000:0.0:1787782151.707123:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782151.707129:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963100800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782151.707157:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963100800:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782151.707163:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782151.707191:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963100800:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.707269:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963100544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.707285:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d6d07da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1874624963101056:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.707296:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963100672:0@lo:400:kworker.0 00000100:00080000:1.0:1787782151.707296:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782151.707299:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782151.707301:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787782151.707308:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d491630c0 x1874624963101184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782151.707330:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1874624963101312:0@lo:400:kworker.0 00000100:00100000:0.0:1787782151.707343:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874624963100928:0@lo:400:kworker.0 00010000:00080000:0.0:1787782151.707352:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c437652c0 x1874624963101440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782151.707532:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1874624963101440:0@lo:400:kworker.0 00000100:00100000:3.0:1787782151.708325:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1874624963101184:0@lo:400:kworker.0 00000100:00100000:2.0:1787782151.709696:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d506ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963100288:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1787782152.071415:0:20087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:1.0:1787782152.199948:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782152.581823:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782153.606444:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782153.612122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612180:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612216:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782153.612334:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089536 00000100:00100000:1.0:1787782153.612343:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089536 00000100:00100000:1.0:1787782153.612386:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 147 00000100:00100000:1.0:1787782153.612394:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2406:x1874624943089536:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612449:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2406:x1874624943089536:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 57us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612456:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 147 00000100:00100000:1.0:1787782153.612486:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089792 00000100:00100000:1.0:1787782153.612489:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089792 00000100:00100000:1.0:1787782153.612512:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090304 00000100:00100000:1.0:1787782153.612514:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090304 00000100:00100000:1.0:1787782153.612523:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089664 00000100:00100000:1.0:1787782153.612525:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089664 00000100:00100000:1.0:1787782153.612534:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090176 00000100:00100000:1.0:1787782153.612536:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090176 00000100:00100000:1.0:1787782153.612546:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:1.0:1787782153.612551:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943089792:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612575:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943089792:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612580:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:1.0:1787782153.612589:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:1.0:1787782153.612593:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090304:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612627:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090304:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612632:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:1.0:1787782153.612647:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:1.0:1787782153.612652:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2406:x1874624943089664:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612672:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2406:x1874624943089664:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 20us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612677:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:1.0:1787782153.612684:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787782153.612688:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2406:x1874624943090176:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612703:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2406:x1874624943090176:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 14us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612707:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:1.0:1787782153.612723:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090048 00000100:00100000:1.0:1787782153.612725:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090048 00000100:00100000:1.0:1787782153.612745:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090560 00000100:00100000:1.0:1787782153.612747:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090560 00000100:00100000:1.0:1787782153.612755:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943089920 00000100:00100000:1.0:1787782153.612756:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943089920 00000100:00100000:1.0:1787782153.612764:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090432 00000100:00100000:1.0:1787782153.612766:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090432 00000100:00100000:1.0:1787782153.612775:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:1.0:1787782153.612780:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943090048:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612809:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943090048:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612815:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:1.0:1787782153.612826:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:1.0:1787782153.612831:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090560:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612852:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090560:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782153.612861:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00100000:1.0:1787782153.612865:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:1.0:1787782153.612876:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:1.0:1787782153.612882:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090432:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782153.612906:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2406:x1874624943090432:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782153.612912:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:2.0:1787782153.612939:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943089920:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782153.612962:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2406:x1874624943089920:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 96us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782153.612968:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 12 00000100:00080000:1.0:1787782153.613085:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782153.613090:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782153.613092:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782153.613094:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787782154.630279:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782154.758046:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963101568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782154.758116:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782154.758243:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101568 00000100:00100000:1.0:1787782154.758250:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101568 00000100:00100000:1.0:1787782154.758319:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782154.758328:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963101568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782154.758354:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782154.758403:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963101568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782154.758410:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782154.758452:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963101568:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787782154.758805:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787782155.654803:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782155.827336:0:20235:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc441a980 20000000:00000080:0.0:1787782155.827359:0:20235:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff993d67fb0400 uarg=0000000000000000 20000000:01000000:0.0:1787782155.827423:0:20235:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787782155.827431:0:20235:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787782155.827437:0:20235:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787782155.829294:0:20236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787782155.829509:0:20235:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787782155.840099:0:20235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787782155.840291:0:20235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840315:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064651 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840342:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840349:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c1506469e expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840356:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840367:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840376:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840385:0:20235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840439:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.840456:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 12 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.840473:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101696:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782155.841412:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.841426:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.841451:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101824:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782155.841501:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.841510:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.841519:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101952:0@lo:104: 00000100:00100000:1.0:1787782155.842043:0:20235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782155.842099:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.842109:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 23 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.842119:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102080:0@lo:104: 00000100:00100000:1.0:1787782155.842145:0:20235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782155.842326:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.842336:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.842345:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102208:0@lo:104: 00000100:00100000:1.0:1787782155.842389:0:20235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782155.843679:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.843714:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 23 pid: 17203 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.843728:0:20235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102336:0@lo:104: 00000100:00100000:1.0:1787782155.843789:0:20235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782155.844116:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963101952 00000100:00100000:3.0:1787782155.844124:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963101952 00000100:00100000:3.0:1787782155.844307:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102080 00000100:00100000:3.0:1787782155.844312:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102080 00000100:00100000:3.0:1787782155.844328:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102208 00000100:00100000:3.0:1787782155.844331:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102208 00000100:00100000:3.0:1787782155.844348:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782155.844358:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:20235:x1874624963101952:12345-0@lo:104: 00010000:00010000:3.0:1787782155.844373:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782155.844507:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782155.844515:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+5:20235:x1874624963101952:12345-0@lo:104: Request processed in 158us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782155.844533:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782155.844555:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782155.844572:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:20235:x1874624963102080:12345-0@lo:104: 00010000:00010000:3.0:1787782155.844582:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845159:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782155.845170:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845194:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e5600 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782155.845199:0:19545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845219:0:19545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782155.845226:0:19545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782155.845232:0:19545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782155.845285:0:19545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845293:0:19545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782155.845321:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845329:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d412e5600/0xc6d6745c15064738 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c1506473f expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845347:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782155.845351:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845356:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d412e4400 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:2.0:1787782155.845360:0:19545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845366:0:19545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782155.845373:0:19545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782155.845385:0:19545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782155.845402:0:19545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845408:0:19545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782155.845426:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845433:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d412e4400/0xc6d6745c1506469e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c150646a5 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845446:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782155.845447:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782155.845449:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782155.845468:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963102464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782155.845516:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782155.845585:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963102592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782155.845632:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782155.845672:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102464 00000100:00100000:2.0:1787782155.845678:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102464 00010000:00010000:2.0:1787782155.845704:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 24 pid: 17201 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782155.845727:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102592 00000100:00100000:2.0:1787782155.845730:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102592 00010000:00010000:2.0:1787782155.845754:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 25 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782155.845769:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782155.845784:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+25:3660:x1874624963102464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782155.845800:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782155.845806:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 25 pid: 17201 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845816:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 25 pid: 17201 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845849:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782155.845890:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+25:3660:x1874624963102464:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782155.845898:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782155.845916:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782155.845923:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3657:x1874624963102592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782155.845932:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782155.845937:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 24 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.845945:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 24 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.846353:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782155.846392:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3657:x1874624963102592:12345-0@lo:103:ldlm_bl.0 Request processed in 469us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782155.846400:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782155.846451:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963102592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782155.846479:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963102464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782155.847385:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787782155.847398:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:20235:x1874624963102080:12345-0@lo:104: Request processed in 2834us (5250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782155.847409:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782155.847440:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782155.847456:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:20235:x1874624963102208:12345-0@lo:104: 00010000:00010000:3.0:1787782155.847472:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.847651:0:20235:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d78cc0e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787782155.847674:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e4000/0xc6d6745c1506473f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15064738 expref: 23 pid: 17201 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.847690:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101952:0@lo:104: 00010000:00010000:1.0:1787782155.847702:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8000/0xc6d6745c150646a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506469e expref: 22 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.847710:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102080:0@lo:104: 00000100:00100000:1.0:1787782155.847718:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102208:0@lo:104: 00000100:00100000:2.0:1787782155.848064:0:17192:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787782155.848091:0:17192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1787782155.850640:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102336 00000100:00100000:1.0:1787782155.850656:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102336 00000100:00100000:2.0:1787782155.851102:0:20237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787782155.851116:0:20237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:20235:x1874624963102336:12345-0@lo:104: 00010000:00010000:2.0:1787782155.851140:0:20237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851327:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782155.851337:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851346:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfaa00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782155.851351:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851371:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782155.851379:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782155.851386:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787782155.851435:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851441:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782155.851467:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851474:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c1506465f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064666 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851487:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782155.851490:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851516:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc121fc20) 10000000:00010000:0.0:1787782155.851519:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851525:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782155.851531:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782155.851535:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787782155.851550:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851555:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782155.851571:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851578:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.116@tcp lock: ffff993d773f9a00/0xc6d6745c15064651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6d6745c15064658 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.851594:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782155.851595:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782155.851597:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782155.851647:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963102720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782155.851698:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782155.851770:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963102848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782155.851797:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782155.851854:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102720 00000100:00100000:0.0:1787782155.852098:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102720 00010000:00010000:0.0:1787782155.852129:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 22 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782155.852155:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102848 00000100:00100000:0.0:1787782155.852158:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102848 00010000:00010000:0.0:1787782155.852169:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 23 pid: 17203 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782155.852190:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782155.852199:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:3658:x1874624963102720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782155.852212:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782155.852218:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.852228:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.852243:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d412e5800/0xc6d6745c15064666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c1506465f expref: 23 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.852259:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782155.852289:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:3658:x1874624963102720:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782155.852297:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782155.852316:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782155.852323:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963102848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782155.852330:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782155.852335:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 21 pid: 17203 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.852350:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 21 pid: 17203 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.852361:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782155.852388:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:3659:x1874624963102848:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782155.852395:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782155.852446:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3659:1874624963102848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782155.852475:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3658:1874624963102720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782155.852799:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787782155.852809:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+4:20235:x1874624963102208:12345-0@lo:104: Request processed in 5360us (10418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782155.852818:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782155.853454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782155.853782:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782155.853817:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090688 00000100:00100000:3.0:1787782155.853825:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090688 00000100:00100000:1.0:1787782155.853957:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101696:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787782155.853971:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963101824:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782155.853984:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43dfb600/0xc6d6745c15064658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6d6745c15064651 expref: 20 pid: 17203 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782155.853999:0:20235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1874624963102336:0@lo:104: 00010000:00010000:1.0:1787782155.854049:0:20235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854072:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782155.854127:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 13 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782155.854202:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090816 00000100:00100000:3.0:1787782155.854220:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090816 00010000:00010000:3.0:1787782155.854235:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 14 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782155.854311:0:20237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787782155.854322:0:20237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+3:20235:x1874624963102336:12345-0@lo:104: Request processed in 3207us (10531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782155.854331:0:20237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787782155.854486:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782155.854542:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787782155.854554:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c436f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+14:2408:x1874624943090688:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782155.854581:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782155.854589:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 14 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854603:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 14 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854655:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8400/0xc6d6745c15064992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e1d expref: 14 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854671:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782155.854730:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c436f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2408:x1874624943090688:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 179us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782155.854738:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 13 00000100:00100000:0.0:1787782155.854798:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 14 00000100:00100000:0.0:1787782155.854805:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:2408:x1874624943090816:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782155.854814:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782155.854818:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854828:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.854851:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993d773f8c00/0xc6d6745c15064953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dad expref: 12 pid: 17204 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.855111:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.855122:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855466:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855477:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855485:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855493:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855499:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43dfa800 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782155.855503:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855511:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855536:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782155.855547:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782155.855595:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:2408:x1874624943090816:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 787us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782155.855636:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 14 00010000:00010000:0.0:1787782155.855722:0:20235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.855732:0:20235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782155.855739:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649c3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782156.039319:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787782156.294100:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782156.294133:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782156.294244:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.294709:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963102976 00000100:00100000:3.0:1787782156.294719:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963102976 00000100:00100000:3.0:1787782156.294788:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782156.294800:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963102976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787782156.294845:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787782156.295047:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963102976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 249us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782156.295056:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787782156.295149:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787782156.295816:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963103104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782156.295945:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782156.300437:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103104 00000100:00100000:2.0:1787782156.300462:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103104 00000100:00100000:2.0:1787782156.300647:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787782156.300659:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963103104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787782156.300708:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787782156.300822:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963103104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (4876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782156.300843:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787782156.302187:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963103104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787782156.677937:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782156.806211:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963103488:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806311:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.806354:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963104000:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806383:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.806400:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963104512:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806425:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.806452:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787782156.806458:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963103360:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806481:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.806497:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963103872:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806517:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.806533:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963104384:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.806554:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.806826:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963103616:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.806984:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.807018:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963104128:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807045:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.807062:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787782156.807068:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963103232:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807098:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.807128:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963103744:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807151:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.807172:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963104256:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807194:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.807227:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103488 00000100:00100000:1.0:1787782156.807235:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103488 00000100:00100000:1.0:1787782156.807293:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103360 00000100:00100000:1.0:1787782156.807297:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103360 00000100:00100000:1.0:1787782156.807313:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103872 00000100:00100000:1.0:1787782156.807315:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103872 00000100:00100000:1.0:1787782156.807327:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103744 00000100:00100000:1.0:1787782156.807330:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103744 00000100:00100000:1.0:1787782156.807347:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782156.807356:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963103488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807419:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963103488:12345-0@lo:400:kworker.0 Request processed in 63us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.807427:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782156.807444:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782156.807450:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963103360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807496:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963103360:12345-0@lo:400:kworker.0 Request processed in 46us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.807503:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782156.807515:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782156.807521:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963103872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807549:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d6d07da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963103872:12345-0@lo:400:kworker.0 Request processed in 28us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.807556:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782156.807568:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782156.807574:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963103744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.807633:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874624963103744:12345-0@lo:400:kworker.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.807640:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782156.807660:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104000 00000100:00100000:1.0:1787782156.807664:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104000 00000100:00100000:1.0:1787782156.807685:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104512 00000100:00100000:1.0:1787782156.807688:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104512 00000100:00100000:1.0:1787782156.807703:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104384 00000100:00100000:1.0:1787782156.807705:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104384 00000100:00100000:1.0:1787782156.807718:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103616 00000100:00100000:1.0:1787782156.807721:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103616 00000100:00100000:1.0:1787782156.807731:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104128 00000100:00100000:1.0:1787782156.807734:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104128 00000100:00100000:0.0:1787782156.807978:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782156.807990:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963104640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782156.808040:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.808077:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104640 00000100:00100000:0.0:1787782156.808082:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104640 00000100:00100000:0.0:1787782156.808113:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782156.808120:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963104640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782156.808149:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787782156.808191:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963104640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782156.808199:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782156.808249:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963104640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782156.808542:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963103360:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.808568:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963103872:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.808582:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963103488:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.808628:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d7fa9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963104768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782156.808657:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782156.808692:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104768 00000100:00100000:3.0:1787782156.808696:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104768 00000100:00100000:0.0:1787782156.808987:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963104896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782156.809026:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.809091:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104256 00000100:00100000:1.0:1787782156.809095:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104256 00000100:00100000:1.0:1787782156.809114:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787782156.809122:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963104000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809166:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963104000:12345-0@lo:400:kworker.0 Request processed in 45us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809180:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787782156.809195:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782156.809203:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963104512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809239:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d491630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963104512:12345-0@lo:400:kworker.0 Request processed in 38us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809245:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782156.809259:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782156.809266:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963104384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809301:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963104384:12345-0@lo:400:kworker.0 Request processed in 36us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809307:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782156.809321:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782156.809328:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963103616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809359:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874624963103616:12345-0@lo:400:kworker.0 Request processed in 31us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809365:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782156.809379:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782156.809385:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963104128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809414:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874624963104128:12345-0@lo:400:kworker.0 Request processed in 30us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809420:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782156.809431:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782156.809437:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963104256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809465:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874624963104256:12345-0@lo:400:kworker.0 Request processed in 29us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809479:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782156.809545:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963103232 00000100:00100000:1.0:1787782156.809550:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963103232 00000100:00100000:1.0:1787782156.809597:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787782156.809604:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:3657:x1874624963103232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809665:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:3657:x1874624963103232:12345-0@lo:400:kworker.0 Request processed in 62us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.809671:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1787782156.809706:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782156.809723:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787782156.809728:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782156.809732:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782156.809774:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3657:1874624963103232:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809790:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1874624963103744:0@lo:400:kworker.0 00010000:00080000:1.0:1787782156.809804:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43767c00 x1874624963104256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782156.809816:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1874624963104256:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809827:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874624963103616:0@lo:400:kworker.0 00000100:00100000:1.0:1787782156.809840:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1874624963104128:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.814184:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963104896 00000100:00100000:3.0:1787782156.814206:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963104896 00000100:00100000:3.0:1787782156.814279:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782156.814290:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963104768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782156.814334:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787782156.814448:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963104768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (5790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782156.814456:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782156.814477:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782156.814483:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963104896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787782156.814495:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787782156.814536:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963104896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782156.814543:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782156.814632:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963104384:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.814651:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963104000:0@lo:400:kworker.0 00010000:00080000:3.0:1787782156.814667:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993c43766d00 x1874624963104512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782156.814696:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963104512:0@lo:400:kworker.0 00000100:00100000:3.0:1787782156.814771:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963104896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782156.815149:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d7fa9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963104768:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1787782156.869703:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787782156.869714:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993c410b3800 from 13 10000000:01000000:0.0:1787782156.869721:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782156.869783:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.869798:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.869811:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782156.869932:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.870041:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.870096:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.870165:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105024 00000100:00100000:1.0:1787782156.870176:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105024 00000100:00100000:1.0:1787782156.870248:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787782156.870258:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+20:17206:x1874624963105024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782156.870274:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782156.870298:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150649ca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.870325:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150649ca expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.870337:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfa800/0xc6d6745c150649d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150649ca expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.870346:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfa800, rc 0) 00000100:00100000:1.0:1787782156.870402:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.870409:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787782156.871459:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782156.871488:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649d1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.871499:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150649d1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782156.871600:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.871684:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.871723:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.872057:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105152 00000100:00100000:1.0:1787782156.872065:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105152 00000100:00100000:1.0:1787782156.872114:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787782156.872123:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.872285:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.872293:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787782156.872385:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782156.872452:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782156.872499:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782156.872530:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.872585:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105280 00000100:00100000:1.0:1787782156.872590:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105280 00000100:00100000:1.0:1787782156.872648:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787782156.872656:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.872744:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.872752:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787782156.872836:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f67c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787782156.874084:0:20267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787782156.876847:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787782156.876978:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782156.876993:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649d1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.877007:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8c00/0xc6d6745c150649ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649d1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782156.877030:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782156.877033:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d44432000 from 13 10000000:01000000:1.0:1787782156.877036:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782156.877083:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.877093:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.877105:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782156.877138:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.877228:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.877326:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d78cc0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782156.877372:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105408 00000100:00100000:2.0:1787782156.877382:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105408 00000100:00100000:2.0:1787782156.877483:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787782156.877494:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+21:17206:x1874624963105408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782156.877510:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782156.877525:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d43038200/0xc6d6745c150649df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150649d8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782156.877552:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d43038200/0xc6d6745c150649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150649d8 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782156.877565:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d43038200/0xc6d6745c150649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150649d8 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782156.877586:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038200, rc 0) 00000100:00100000:2.0:1787782156.877686:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782156.877695:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787782156.877865:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782156.877884:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649df expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.877894:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150649df expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782156.877973:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.878004:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.878303:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.878630:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105536 00000100:00100000:1.0:1787782156.878637:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105536 00000100:00100000:1.0:1787782156.878674:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787782156.878682:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.878835:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.878843:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787782156.879033:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.879081:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.879146:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.879171:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.879226:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105664 00000100:00100000:1.0:1787782156.879238:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105664 00000100:00100000:1.0:1787782156.879258:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787782156.879264:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.879396:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.879403:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787782156.879775:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787782156.881085:0:20268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787782156.881305:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787782156.881335:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787782156.881348:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649df expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.881361:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfaa00/0xc6d6745c150649d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649df expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782156.881374:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787782156.881377:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993d67ccb800 from 13 10000000:01000000:0.0:1787782156.881380:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782156.881424:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.881433:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.881446:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782156.881474:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.881548:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.881979:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.882033:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105792 00000100:00100000:1.0:1787782156.882042:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105792 00000100:00100000:1.0:1787782156.882139:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787782156.882150:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+22:17206:x1874624963105792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782156.882166:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782156.882183:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c43dfb000/0xc6d6745c150649ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150649e6 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.882214:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c43dfb000/0xc6d6745c150649ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150649e6 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.882227:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c43dfb000/0xc6d6745c150649ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150649e6 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.882237:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43dfb000, rc 0) 00000100:00100000:1.0:1787782156.882339:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d79c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963105792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.882347:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787782156.882439:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782156.882458:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649ed expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782156.882491:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150649ed expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782156.883018:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.883064:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.883154:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.883230:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963105920 00000100:00100000:1.0:1787782156.883237:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963105920 00000100:00100000:1.0:1787782156.883289:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787782156.883298:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963105920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.883450:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963105920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.883458:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787782156.883552:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963105920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.883620:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.883666:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.883688:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.883802:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963106048 00000100:00100000:1.0:1787782156.883807:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963106048 00000100:00100000:1.0:1787782156.883838:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787782156.883845:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963106048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.883938:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963106048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.883946:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787782156.884327:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787782156.885484:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787782156.886484:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787782156.886522:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782156.886536:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649ed expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.886550:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993d773f8400/0xc6d6745c150649e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649ed expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782156.886576:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782156.886580:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff993c4442b000 from 13 10000000:01000000:1.0:1787782156.886583:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782156.886657:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.886667:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.886680:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782156.886736:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.886832:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.887032:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d78cc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782156.887062:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963106176 00000100:00100000:1.0:1787782156.887070:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963106176 00000100:00100000:1.0:1787782156.887125:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787782156.887134:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+23:17206:x1874624963106176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782156.887149:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782156.887182:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c425a5200/0xc6d6745c150649fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6d6745c150649f4 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.887211:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c425a5200/0xc6d6745c150649fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6d6745c150649f4 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.887223:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c425a5200/0xc6d6745c150649fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6d6745c150649f4 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.887233:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5200, rc 0) 00000100:00100000:1.0:1787782156.887278:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963106176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782156.887285:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787782156.887335:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782156.887351:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649fb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782156.887360:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6d6745c150649fb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782156.887431:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782156.887459:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782156.887473:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d78cc03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782156.887583:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963106304 00000100:00100000:0.0:1787782156.887588:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963106304 00000100:00100000:0.0:1787782156.887637:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787782156.887646:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963106304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.887771:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963106304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782156.887779:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787782156.887809:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.887840:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.887997:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782156.888030:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963106432 00000100:00100000:0.0:1787782156.888040:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963106432 00000100:00100000:0.0:1787782156.888060:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787782156.888065:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963106432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782156.888142:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:17206:x1874624963106432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782156.888149:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787782156.888181:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d80adcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782156.888193:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:919c9bfc-060e-4da8-a874-7b13cf1bdaec:17206:1874624963106432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787782156.890230:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787782156.890485:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787782156.890514:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782156.890528:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649fb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782156.890540:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.116@tcp lock: ffff993c43dfb600/0xc6d6745c150649f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6d6745c150649fb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782157.577347:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782157.578034:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943090944 00000100:00100000:0.0:1787782157.578049:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943090944 00000100:00100000:0.0:1787782157.578179:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:0.0:1787782157.578191:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+11:14956:x1874624943090944:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782157.578214:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782157.578237:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993d773f8800/0xc6d6745c15064a02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e55 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782157.578274:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993d773f8800/0xc6d6745c15064a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e55 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782157.578286:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993d773f8800/0xc6d6745c15064a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e55 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782157.578296:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8800, rc 0) 00000100:00100000:0.0:1787782157.578375:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943090944:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 186us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782157.578383:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 161 00000100:00100000:3.0:1787782157.585751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782157.585942:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091072 00000100:00100000:1.0:1787782157.585954:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091072 00000100:00100000:1.0:1787782157.586067:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00100000:1.0:1787782157.586079:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943091072:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782157.586263:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943091072:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 187us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782157.586272:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 162 00000100:00100000:2.0:1787782157.591990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782157.592077:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091200 00000100:00100000:0.0:1787782157.592092:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091200 00000100:00100000:0.0:1787782157.592227:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 163 00000100:00100000:0.0:1787782157.592244:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943091200:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782157.593816:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943091200:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 1490us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782157.593833:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 163 00000100:00100000:3.0:1787782157.601468:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782157.601812:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091328 00000100:00100000:1.0:1787782157.601828:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091328 00000100:00100000:1.0:1787782157.601918:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 164 00000100:00100000:1.0:1787782157.601930:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+12:14956:x1874624943091328:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782157.601954:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782157.601977:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff993c425a5800/0xc6d6745c15064a09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e5c expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782157.602027:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff993c425a5800/0xc6d6745c15064a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e5c expref: 13 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782157.602041:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff993c425a5800/0xc6d6745c15064a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e5c expref: 13 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782157.602051:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5800, rc 0) 00000100:00100000:1.0:1787782157.602154:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:14956:x1874624943091328:12345-192.168.206.16@tcp:101:ll_cfg_requeue.0 Request processed in 226us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782157.602172:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 164 00000100:00100000:2.0:1787782157.606334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782157.606518:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091456 00000100:00100000:1.0:1787782157.606532:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091456 00000100:00100000:1.0:1787782157.606657:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 165 00000100:00100000:1.0:1787782157.606670:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:14956:x1874624943091456:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782157.606960:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:14956:x1874624943091456:12345-192.168.206.16@tcp:501:ll_cfg_requeue.0 Request processed in 291us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782157.606970:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 165 00000100:00100000:3.0:1787782157.613526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782157.613697:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091584 00000100:00100000:2.0:1787782157.613710:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091584 00000100:00100000:2.0:1787782157.613802:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 166 00000100:00100000:2.0:1787782157.613814:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:14956:x1874624943091584:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782157.613989:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:14956:x1874624943091584:12345-192.168.206.16@tcp:503:ll_cfg_requeue.0 Request processed in 176us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782157.613998:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 166 00010000:00010000:0.0:1787782157.704518:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782158.726520:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782158.729718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729790:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729870:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729891:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782158.729907:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782158.730018:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092096 00000100:00100000:0.0:1787782158.730028:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092096 00000100:00100000:0.0:1787782158.730081:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092224 00000100:00100000:0.0:1787782158.730084:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092224 00000100:00100000:0.0:1787782158.730099:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092736 00000100:00100000:0.0:1787782158.730102:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092736 00000100:00100000:0.0:1787782158.730118:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787782158.730126:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2409:x1874624943092096:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782158.730192:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2409:x1874624943092096:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 66us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782158.730201:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787782158.730216:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:0.0:1787782158.730222:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943092224:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782158.730245:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943092224:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782158.730251:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:0.0:1787782158.730263:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:0.0:1787782158.730268:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943092736:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782158.730309:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943092736:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782158.730315:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00080000:3.0:1787782158.730380:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782158.730513:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782158.730757:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091712 00000100:00100000:1.0:1787782158.730762:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091712 00000100:00100000:1.0:1787782158.730797:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00100000:1.0:1787782158.730804:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2408:x1874624943091712:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782158.730835:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2408:x1874624943091712:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 32us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782158.730841:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 167 00000100:00100000:1.0:1787782158.730867:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091840 00000100:00100000:1.0:1787782158.730871:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091840 00000100:00100000:1.0:1787782158.730892:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943091968 00000100:00100000:1.0:1787782158.730895:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943091968 00000100:00100000:1.0:1787782158.730906:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092352 00000100:00100000:1.0:1787782158.730908:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092352 00000100:00100000:1.0:1787782158.730930:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092480 00000100:00100000:1.0:1787782158.730932:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092480 00000100:00100000:1.0:1787782158.730946:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:1.0:1787782158.730952:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2409:x1874624943091840:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782158.730988:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2409:x1874624943091840:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 35us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782158.730995:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:1.0:1787782158.731017:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:1.0:1787782158.731024:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943091968:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782158.731065:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943091968:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 42us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782158.731071:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:1.0:1787782158.731083:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:1.0:1787782158.731088:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2409:x1874624943092352:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782158.731109:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2409:x1874624943092352:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782158.731114:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:1.0:1787782158.731125:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00100000:1.0:1787782158.731131:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943092480:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782158.731151:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943092480:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 21us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782158.731156:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 65 00000100:00080000:3.0:1787782158.731585:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787782158.731592:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782158.732289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782158.732588:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092608 00000100:00100000:0.0:1787782158.732596:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092608 00000100:00100000:0.0:1787782158.733190:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:0.0:1787782158.733202:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2409:x1874624943092608:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:0.0:1787782158.733285:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2409:x1874624943092608:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 86us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782158.733293:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00080000:3.0:1787782158.736415:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782159.700597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782159.702414:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092864 00000100:00100000:1.0:1787782159.702428:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092864 00000100:00100000:1.0:1787782159.702507:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:1.0:1787782159.702518:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:15623:x1874624943092864:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782159.702538:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782159.702584:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4600/0xc6d6745c15064a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e63 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702675:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702688:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702700:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702714:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702721:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702727:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702805:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4a00/0xc6d6745c15064a25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702814:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4a00/0xc6d6745c15064a25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702822:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4a00/0xc6d6745c15064a25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782159.702854:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787782159.702858:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787782159.702900:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4a00/0xc6d6745c15064a25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702931:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702938:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702946:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702952:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a5600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782159.702958:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702965:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.702979:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:1.0:1787782159.702983:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782159.702987:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.703003:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.703017:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.703024:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.703029:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704288:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782159.704294:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704302:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704316:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff993c42528400) 00010000:00010000:1.0:1787782159.704318:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782159.704323:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704330:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704383:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4600/0xc6d6745c15064a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e63 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704397:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4a00/0xc6d6745c15064a25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e63 expref: 7 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.704405:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787782159.704408:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782159.704410:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a4a00, rc 0) 00000100:00100000:1.0:1787782159.704477:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15623:x1874624943092864:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 1960us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782159.704486:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 23 00000100:00100000:2.0:1787782159.711300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782159.711392:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943092992 00000100:00100000:0.0:1787782159.711402:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943092992 00000100:00100000:0.0:1787782159.711460:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:0.0:1787782159.711470:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15623:x1874624943092992:12345-192.168.206.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787782159.711554:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15623:x1874624943092992:12345-192.168.206.16@tcp:900:lhsmtool_posix.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782159.711575:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:3.0:1787782159.719729:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782159.719833:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943093248 00000100:00100000:1.0:1787782159.719855:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943093248 00000100:00100000:1.0:1787782159.719922:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787782159.719932:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15623:x1874624943093248:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782159.719951:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782159.719970:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4600/0xc6d6745c15064a2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e6a expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720063:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720078:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720088:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720147:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720154:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720160:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720260:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5a00/0xc6d6745c15064a41 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720269:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5a00/0xc6d6745c15064a41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720275:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5a00/0xc6d6745c15064a41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782159.720292:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787782159.720434:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720442:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720449:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720456:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782159.720460:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720468:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720480:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff993c42528300) 00010000:00010000:1.0:1787782159.720484:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782159.720488:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720494:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064a33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720507:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720513:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720529:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720534:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a5600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782159.720537:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720542:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720550:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff993c42528400) 00010000:00010000:1.0:1787782159.720553:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782159.720555:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.720562:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5600/0xc6d6745c15064a3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.721523:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4600/0xc6d6745c15064a2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e6a expref: 10 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.721544:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5a00/0xc6d6745c15064a41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e6a expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782159.721553:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993c42528100) 00010000:00010000:1.0:1787782159.721697:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782159.721701:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5a00, rc 0) 00000100:00100000:1.0:1787782159.721769:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15623:x1874624943093248:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 1838us (2050us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787782159.721789:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787782159.732750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782159.732950:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943093376 00000100:00100000:2.0:1787782159.732967:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943093376 00000100:00100000:2.0:1787782159.733046:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:2.0:1787782159.733057:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15623:x1874624943093376:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787782159.733159:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15623:x1874624943093376:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 104us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782159.733168:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:2.0:1787782159.743894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782159.744059:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943093504 00000100:00100000:1.0:1787782159.744070:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943093504 00000100:00100000:1.0:1787782159.744149:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:1.0:1787782159.744160:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:15623:x1874624943093504:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787782159.747423:0:18983:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3218us 00010000:00010000:3.0:1787782159.752823:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782159.782083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782159.782230:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943093632 00000100:00100000:3.0:1787782159.782239:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943093632 00000100:00100000:3.0:1787782159.782294:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:3.0:1787782159.782304:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15629:x1874624943093632:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787782159.782335:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782159.782358:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15064a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e71 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782415:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782429:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782441:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782455:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782462:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782468:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782510:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782518:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782524:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782530:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782159.782540:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.782548:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787168:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:3.0:1787782159.787179:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782159.787187:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787198:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787220:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787227:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787234:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787239:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43704600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782159.787243:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787250:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787258:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993d6d095e00) 00010000:00010000:3.0:1787782159.787261:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782159.787272:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787278:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787328:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15064a4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e71 expref: 10 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787339:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:3.0:1787782159.787342:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782159.787345:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15064a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e71 expref: 10 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.787355:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43705c00, rc 0) 00000100:00100000:3.0:1787782159.787439:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15629:x1874624943093632:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 5135us (5363us total) trans 0 rc 301/301 00000100:00100000:3.0:1787782159.787448:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:2.0:1787782159.793341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782159.793686:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943093760 00000100:00100000:3.0:1787782159.793696:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943093760 00000100:00100000:3.0:1787782159.793743:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:3.0:1787782159.793754:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15629:x1874624943093760:12345-192.168.206.16@tcp:700:lfs.0 00000100:00100000:3.0:1787782159.793836:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15629:x1874624943093760:12345-192.168.206.16@tcp:700:lfs.0 Request processed in 83us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782159.793844:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:3.0:1787782159.798470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782159.798558:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094016 00000100:00100000:0.0:1787782159.798568:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094016 00000100:00100000:0.0:1787782159.798658:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:0.0:1787782159.798669:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:15629:x1874624943094016:12345-192.168.206.16@tcp:36:lfs.0 00010000:00010000:0.0:1787782159.798724:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782159.798749:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c1506497d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83dde expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.798785:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:0.0:1787782159.798790:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782159.798847:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.798860:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 5 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.798870:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.798912:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 5 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.798925:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 5 pid: 18983 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782159.798938:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1874624963106560:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787782159.799031:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027900 going to sleep for 11 seconds 00000100:00100000:2.0:1787782159.801081:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1874624963106560:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787782159.801110:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782159.802641:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:15623:x1874624943093504:12345-192.168.206.16@tcp:59:lhsmtool_posix.0 Request processed in 58435us (58709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782159.802677:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:2.0:1787782159.806803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782159.806898:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094144 00000100:00100000:0.0:1787782159.806908:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094144 00010000:00010000:0.0:1787782159.806961:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 6 pid: 18983 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782159.807009:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 15 00000100:00100000:0.0:1787782159.807019:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2407:x1874624943094144:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782159.807045:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782159.807053:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 6 pid: 18983 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807067:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 6 pid: 18983 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807091:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c150649bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e4e expref: 6 pid: 18983 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807104:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:0.0:1787782159.807108:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807116:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807123:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.807325:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782159.807379:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2407:x1874624943094144:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 360us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782159.807387:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 15 00010000:00010000:3.0:1787782159.811802:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.811820:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.815781:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.815803:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.815817:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820335:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820358:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820372:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782159.820393:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057319b0a reply state 000000008b5e7b7c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820404:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820411:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:2.0:1787782159.820414:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787782159.820418:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787782159.820424:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787782159.820433:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820439:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820446:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820452:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782159.820456:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820477:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820489:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03400) 00010000:00010000:2.0:1787782159.820491:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782159.820496:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820502:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9400/0xc6d6745c15064a64 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782159.820523:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057319b0a reply state 000000008b5e7b7c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820531:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782159.820537:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993c436a6000) 00010000:00010000:2.0:1787782159.820539:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787782159.820541:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787782159.821132:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+10:15629:x1874624943094016:12345-192.168.206.16@tcp:36:lfs.0 Request processed in 22460us (22666us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787782159.821278:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:3.0:1787782159.878250:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963106688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787782159.878332:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782159.878444:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963106688 00000100:00100000:0.0:1787782159.878453:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963106688 00000100:00100000:0.0:1787782159.878520:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787782159.878532:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963106688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787782159.878570:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787782159.878658:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963106688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782159.878665:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787782159.878858:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963106688:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787782159.878928:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782159.955821:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782159.956261:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094272 00000100:00100000:2.0:1787782159.956275:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094272 00000100:00100000:2.0:1787782159.956485:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:2.0:1787782159.956497:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+10:15637:x1874624943094272:12345-192.168.206.16@tcp:101:lctl.0 00010000:00010000:2.0:1787782159.956717:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782159.966207:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e78 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966324:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c15064a80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966341:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c15064a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966358:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c15064a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782159.966417:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787782159.966422:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787782159.966467:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c15064a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966515:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e78 expref: 12 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966539:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9200/0xc6d6745c15064a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e78 expref: 11 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782159.966550:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:0.0:1787782159.966553:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782159.966557:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9200, rc 0) 00000100:00100000:0.0:1787782159.966700:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+11:15637:x1874624943094272:12345-192.168.206.16@tcp:101:lctl.0 Request processed in 10203us (10892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782159.966727:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:2.0:1787782159.986594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782159.986821:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094400 00000100:00100000:3.0:1787782159.986833:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094400 00000100:00100000:3.0:1787782159.986901:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:3.0:1787782159.986912:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:15638:x1874624943094400:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787782159.986940:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782159.986966:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15064a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e7f expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987064:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987081:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987093:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782159.987169:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787782159.987189:0:18983:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787782159.987219:0:18983:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987248:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705c00/0xc6d6745c15064a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e7f expref: 7 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987269:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43704600/0xc6d6745c15064a8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e7f expref: 6 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.987279:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:3.0:1787782159.987283:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782159.987287:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c43704600, rc 0) 00000100:00100000:3.0:1787782159.987372:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15638:x1874624943094400:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 461us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782159.987380:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 30 00000100:00100000:3.0:1787782159.990060:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782159.991858:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094528 00000100:00100000:2.0:1787782159.991873:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094528 00000100:00100000:3.0:1787782159.992024:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:3.0:1787782159.992036:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:15638:x1874624943094528:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787782159.992064:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782159.992090:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e86 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992203:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992221:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992256:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992270:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992278:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.992285:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993021:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993036:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993046:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782159.993098:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787782159.993102:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787782159.993126:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993140:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993147:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993168:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993175:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782159.993180:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993189:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993331:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:3.0:1787782159.993335:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782159.993341:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993349:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705200/0xc6d6745c15064a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993469:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993478:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993485:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993490:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c43705400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782159.993494:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993511:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993521:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993c436a6000) 00010000:00010000:3.0:1787782159.993524:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782159.993527:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993534:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705400/0xc6d6745c15064aa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993682:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c43705a00/0xc6d6745c15064a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e86 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993698:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e86 expref: 7 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782159.993706:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:3.0:1787782159.993709:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782159.993712:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166a00, rc 0) 00000100:00100000:3.0:1787782159.994014:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+7:15638:x1874624943094528:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 1976us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782159.994026:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 31 00000100:00100000:0.0:1787782160.004811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782160.004913:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094656 00000100:00100000:1.0:1787782160.004928:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094656 00000100:00080000:3.0:1787782160.005019:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787782160.005036:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:1.0:1787782160.005048:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0e00f26-a408-40f6-8a81-b71e91755e01+5:15638:x1874624943094656:12345-192.168.206.16@tcp:900:lfs.0 00000100:00100000:1.0:1787782160.005367:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0e00f26-a408-40f6-8a81-b71e91755e01+5:15638:x1874624943094656:12345-192.168.206.16@tcp:900:lfs.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782160.005376:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:2.0:1787782160.010419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.010950:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943094912 00000100:00100000:3.0:1787782160.010964:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943094912 00000100:00100000:3.0:1787782160.011062:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 32 00000100:00100000:3.0:1787782160.011076:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+7:15638:x1874624943094912:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:3.0:1787782160.011127:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782160.011156:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e8d expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782160.011286:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00080000:0.0:1787782160.011524:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787782160.014248:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064ab1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e8d expref: 9 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.014273:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:3.0:1787782160.014278:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782160.014285:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e8d expref: 9 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.014306:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167000, rc 0) 00000100:00100000:3.0:1787782160.014406:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+8:15638:x1874624943094912:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 3332us (3997us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787782160.014419:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 32 00000100:00100000:3.0:1787782160.021984:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.022269:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943095168 00000100:00100000:0.0:1787782160.022283:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943095168 00000100:00100000:0.0:1787782160.022362:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:0.0:1787782160.022374:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+8:15638:x1874624943095168:12345-192.168.206.16@tcp:36:lfs.0 00010000:00010000:0.0:1787782160.022455:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782160.022490:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166a00/0xc6d6745c15064aaa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e86 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.022515:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:0.0:1787782160.022520:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782160.022559:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.022576:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.022587:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782160.039724:0:17209:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8355f88 reply state 00000000950d2aab transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.039764:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.039777:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:1.0:1787782160.039781:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787782160.039788:0:17209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787782160.039808:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787782160.039969:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d7fa9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+9:15638:x1874624943095168:12345-192.168.206.16@tcp:36:lfs.0 Request processed in 17590us (17994us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787782160.040015:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 33 00000100:00100000:0.0:1787782160.046188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.047209:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943095424 00000100:00100000:2.0:1787782160.047225:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943095424 00000100:00100000:2.0:1787782160.047312:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:2.0:1787782160.047326:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+9:15638:x1874624943095424:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:2.0:1787782160.047698:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+10:15638:x1874624943095424:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 373us (1524us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787782160.047707:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:2.0:1787782160.050527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.050892:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943095680 00000100:00100000:0.0:1787782160.050905:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943095680 00000100:00100000:0.0:1787782160.050980:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:0.0:1787782160.051004:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0e00f26-a408-40f6-8a81-b71e91755e01+10:15638:x1874624943095680:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787782160.051035:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.051079:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15064ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e94 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051175:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051193:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051206:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051218:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051226:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051232:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782160.051377:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787782160.051472:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051480:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051486:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051491:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787782160.051495:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051512:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051525:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:0.0:1787782160.051528:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782160.051533:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051539:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051553:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051560:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051565:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051570:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787782160.051573:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051580:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051587:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993c436a6000) 00010000:00010000:0.0:1787782160.051589:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782160.051591:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051674:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064ad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051723:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15064ac6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e94 expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051735:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:0.0:1787782160.051737:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782160.051741:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8a00/0xc6d6745c15064ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e94 expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.051750:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8a00, rc 0) 00000100:00100000:0.0:1787782160.051837:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0e00f26-a408-40f6-8a81-b71e91755e01+11:15638:x1874624943095680:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 845us (1327us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787782160.051847:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 34 00000100:00100000:3.0:1787782160.056298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.056383:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943095808 00000100:00100000:0.0:1787782160.056396:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943095808 00000100:00100000:0.0:1787782160.056491:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:0.0:1787782160.056505:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+11:15638:x1874624943095808:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787782160.056538:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.056567:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064ae2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83e9b expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.056718:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.056737:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.056769:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782160.056814:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787782160.056819:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787782160.057079:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.057114:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064ae2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 13 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.057132:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 12 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.057142:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:0.0:1787782160.057145:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782160.057149:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8000, rc 0) 00000100:00100000:0.0:1787782160.057230:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+12:15638:x1874624943095808:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 728us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.058495:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 35 00000100:00100000:3.0:1787782160.062753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.064099:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943095936 00000100:00100000:0.0:1787782160.064119:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943095936 00000100:00100000:0.0:1787782160.064217:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:0.0:1787782160.064231:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+12:15638:x1874624943095936:12345-192.168.206.16@tcp:37:lfs.0 00000100:00100000:0.0:1787782160.085233:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+12:15638:x1874624943095936:12345-192.168.206.16@tcp:37:lfs.0 Request processed in 20989us (22481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.085649:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 3 00000100:00100000:2.0:1787782160.102404:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.102525:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096192 00000100:00100000:0.0:1787782160.102540:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096192 00000100:00100000:0.0:1787782160.102678:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 4 00000100:00100000:0.0:1787782160.102691:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+12:15638:x1874624943096192:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787782160.103438:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0e00f26-a408-40f6-8a81-b71e91755e01+13:15638:x1874624943096192:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 746us (1044us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787782160.103456:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 4 00000040:00080000:3.0:1787782160.134330:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782160.177381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.177498:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096320 00000100:00100000:3.0:1787782160.177511:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096320 00000100:00100000:3.0:1787782160.177667:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00100000:3.0:1787782160.177680:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+11:15644:x1874624943096320:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787782160.177709:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782160.177736:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ea2 expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.177842:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.177861:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.177999:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178017:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178026:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178034:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178152:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167a00/0xc6d6745c15064b05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178163:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167a00/0xc6d6745c15064b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178171:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167a00/0xc6d6745c15064b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782160.178215:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787782160.178220:0:18983:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787782160.178266:0:18983:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167a00/0xc6d6745c15064b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178292:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178300:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178308:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178315:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782160.178320:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178331:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178346:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:3.0:1787782160.178350:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782160.178356:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178363:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178379:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178386:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178392:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178403:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d82166200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782160.178408:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178414:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178423:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993c436a6000) 00010000:00010000:3.0:1787782160.178426:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782160.178429:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178436:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064afe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178466:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea2 expref: 13 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178483:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167a00/0xc6d6745c15064b05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea2 expref: 12 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.178491:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:3.0:1787782160.178493:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787782160.178496:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167a00, rc 0) 00000100:00100000:3.0:1787782160.178589:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+12:15644:x1874624943096320:12345-192.168.206.16@tcp:101:bash.0 Request processed in 911us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782160.178598:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 36 00000100:00080000:0.0:1787782160.178795:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782160.181277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.183650:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096448 00000100:00100000:0.0:1787782160.183669:0:17221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096448 00000100:00100000:0.0:1787782160.184117:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:0.0:1787782160.184129:0:17221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:15644:x1874624943096448:12345-192.168.206.16@tcp:900:bash.0 00000100:00080000:3.0:1787782160.184291:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787782160.184319:0:17221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:15644:x1874624943096448:12345-192.168.206.16@tcp:900:bash.0 Request processed in 192us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.184328:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:1.0:1787782160.199018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.199171:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096704 00000100:00100000:2.0:1787782160.199185:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096704 00000100:00100000:2.0:1787782160.199257:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:2.0:1787782160.199267:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+12:15644:x1874624943096704:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:2.0:1787782160.199294:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782160.199320:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038a00/0xc6d6745c15064b0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ea9 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.199522:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.199539:0:17209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 12 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.199563:0:17209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.199631:0:17209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 12 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.199647:0:17209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 12 pid: 17210 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782160.199664:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963106816:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787782160.199813:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782160.203326:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963106816:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782160.203366:0:17209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782160.203568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.204395:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096832 00000100:00100000:3.0:1787782160.204408:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096832 00010000:00010000:3.0:1787782160.204464:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 13 pid: 17210 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782160.204676:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 16 00000100:00100000:3.0:1787782160.204689:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+13:2409:x1874624943096832:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782160.204709:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782160.204717:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 13 pid: 17210 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204733:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 13 pid: 17210 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204761:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8000/0xc6d6745c15064ae9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83e9b expref: 13 pid: 17210 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204783:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:3.0:1787782160.204790:0:17195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204802:0:17195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204810:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.204835:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782160.204953:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+12:2409:x1874624943096832:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 266us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782160.204962:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 16 00010000:00010000:1.0:1787782160.205801:0:17209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.205814:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.205847:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.205873:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.205884:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.206810:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.206827:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207265:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782160.207284:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787782160.207324:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207331:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207338:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207345:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782160.207351:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207360:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207374:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:1.0:1787782160.207378:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782160.207383:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207390:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782160.207407:0:17209:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099ecd03e reply state 00000000928b3ee8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207435:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207442:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff993c42528400) 00010000:00010000:1.0:1787782160.207445:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787782160.207448:0:17209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787782160.207497:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038a00/0xc6d6745c15064b0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 15 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207514:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 14 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782160.207522:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:1.0:1787782160.207524:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787782160.207527:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5e00, rc 0) 00000100:00100000:1.0:1787782160.207976:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+15:15644:x1874624943096704:12345-192.168.206.16@tcp:101:bash.0 Request processed in 8707us (8981us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787782160.207986:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 37 00000100:00100000:2.0:1787782160.238273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.238371:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943096960 00000100:00100000:3.0:1787782160.238385:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943096960 00000100:00100000:3.0:1787782160.238461:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:3.0:1787782160.238474:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+15:15644:x1874624943096960:12345-192.168.206.16@tcp:101:bash.0 00010000:00010000:3.0:1787782160.238506:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782160.238536:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064b2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83eb0 expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.238676:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.238694:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.238710:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782160.238786:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787782160.238791:0:18983:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787782160.238815:0:18983:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.238827:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.238858:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064b2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 17 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.239034:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 16 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.239044:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:3.0:1787782160.239048:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787782160.239052:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166200, rc 0) 00000100:00100000:0.0:1787782160.245144:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+16:15644:x1874624943096960:12345-192.168.206.16@tcp:101:bash.0 Request processed in 6654us (6867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.245161:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 38 00000100:00100000:0.0:1787782160.254588:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782160.254780:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943097216 00000100:00100000:1.0:1787782160.254793:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943097216 00000100:00100000:1.0:1787782160.254853:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:1.0:1787782160.254881:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+16:15644:x1874624943097216:12345-192.168.206.16@tcp:35:bash.0 00000100:00100000:1.0:1787782160.255253:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+17:15644:x1874624943097216:12345-192.168.206.16@tcp:35:bash.0 Request processed in 380us (677us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787782160.255262:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 5 00000100:00100000:2.0:1787782160.382247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.382373:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943097472 00000100:00100000:0.0:1787782160.382385:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943097472 00000100:00100000:0.0:1787782160.382473:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:0.0:1787782160.382486:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+17:15655:x1874624943097472:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:0.0:1787782160.382522:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.382562:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83eb7 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782160.382738:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787782160.382864:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb7 expref: 19 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.382904:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff993d77c03000) 00010000:00010000:0.0:1787782160.382908:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782160.382915:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb7 expref: 19 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.382931:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8600, rc 0) 00000100:00100000:0.0:1787782160.383028:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+18:15655:x1874624943097472:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 545us (795us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787782160.383038:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 39 00000100:00100000:0.0:1787782160.389384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782160.389718:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943097728 00000100:00100000:1.0:1787782160.389747:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943097728 00000100:00100000:1.0:1787782160.389810:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 6 00000100:00100000:1.0:1787782160.389822:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+18:15655:x1874624943097728:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787782160.390142:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15655:x1874624943097728:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 322us (784us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787782160.390164:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 6 00000040:00080000:0.0:1787782160.391688:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787782160.431830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.432414:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943097984 00000100:00100000:2.0:1787782160.432428:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943097984 00000100:00100000:2.0:1787782160.432513:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:2.0:1787782160.432524:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15658:x1874624943097984:12345-192.168.206.16@tcp:101:lfs.0 00010000:00010000:2.0:1787782160.432570:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782160.432595:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c15064b4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ebe expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.432761:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038e00/0xc6d6745c15064b52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.432776:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038e00/0xc6d6745c15064b52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.432804:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038e00/0xc6d6745c15064b52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782160.432816:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787782160.432932:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038c00/0xc6d6745c15064b4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ebe expref: 22 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.432951:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038e00/0xc6d6745c15064b52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ebe expref: 21 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.432959:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.432963:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782160.432966:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038e00, rc 0) 00000100:00100000:2.0:1787782160.433048:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15658:x1874624943097984:12345-192.168.206.16@tcp:101:lfs.0 Request processed in 526us (1230us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787782160.433055:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 40 00000100:00100000:2.0:1787782160.435938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.436039:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943098112 00000100:00100000:0.0:1787782160.436051:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943098112 00000100:00100000:0.0:1787782160.436114:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:0.0:1787782160.436123:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15658:x1874624943098112:12345-192.168.206.16@tcp:54:lfs.0 00010000:00010000:0.0:1787782160.436200:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436218:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436230:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436273:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436280:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436303:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436309:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8600 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:0.0:1787782160.436314:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436322:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436335:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.436339:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782160.436344:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.436350:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782160.436443:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15658:x1874624943098112:12345-192.168.206.16@tcp:54:lfs.0 Request processed in 320us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.436451:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 41 00000100:00100000:0.0:1787782160.443277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.443354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.443428:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943098496 00000100:00100000:2.0:1787782160.443441:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943098496 00000100:00100000:2.0:1787782160.443531:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:2.0:1787782160.443552:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:2409:x1874624943098496:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782160.443582:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782160.443690:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038e00/0xc6d6745c15064b52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ebe expref: 21 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.443720:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.443751:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782160.443820:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+20:2409:x1874624943098496:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 278us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782160.443829:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:1.0:1787782160.443949:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943098368 00000100:00100000:1.0:1787782160.443954:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943098368 00000100:00100000:1.0:1787782160.444016:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:1.0:1787782160.444027:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+20:15658:x1874624943098368:12345-192.168.206.16@tcp:35:lfs.0 00000100:00100000:1.0:1787782160.444270:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15658:x1874624943098368:12345-192.168.206.16@tcp:35:lfs.0 Request processed in 246us (1017us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787782160.444277:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 7 00000100:00100000:2.0:1787782160.740137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.741055:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943098752 00000100:00100000:0.0:1787782160.741070:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943098752 00000100:00100000:0.0:1787782160.741159:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:0.0:1787782160.741170:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15689:x1874624943098752:12345-192.168.206.16@tcp:101:cat.0 00010000:00010000:0.0:1787782160.741204:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.741252:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ec5 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.741394:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.741410:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.741423:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782160.741436:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787782160.741594:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ec5 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.741693:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ec5 expref: 23 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.741704:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.741708:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782160.741712:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9000, rc 0) 00000100:00100000:0.0:1787782160.741859:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:15689:x1874624943098752:12345-192.168.206.16@tcp:101:cat.0 Request processed in 690us (1737us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787782160.741866:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 42 00000100:00100000:3.0:1787782160.746552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.746601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782160.747274:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099008 00000100:00100000:1.0:1787782160.747289:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099008 00000100:00100000:1.0:1787782160.747360:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:1.0:1787782160.747372:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:15689:x1874624943099008:12345-192.168.206.16@tcp:35:cat.0 00000100:00100000:1.0:1787782160.747774:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:15689:x1874624943099008:12345-192.168.206.16@tcp:35:cat.0 Request processed in 402us (1170us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787782160.747783:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 8 00000100:00100000:0.0:1787782160.748544:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099136 00000100:00100000:0.0:1787782160.748556:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099136 00000100:00100000:0.0:1787782160.748641:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:0.0:1787782160.748651:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:2406:x1874624943099136:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782160.748686:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782160.748716:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ec5 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.748736:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.748742:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782160.748782:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:2406:x1874624943099136:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 134us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.748788:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00010000:00010000:0.0:1787782160.773997:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782160.806010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.806177:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099392 00000100:00100000:3.0:1787782160.806191:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099392 00000100:00100000:3.0:1787782160.806273:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:3.0:1787782160.806286:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:15695:x1874624943099392:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:3.0:1787782160.806319:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782160.806348:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064b7c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ecc expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806500:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806516:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806525:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 24 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806700:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806743:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 24 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.806761:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 24 pid: 18983 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782160.806779:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1874624963106944:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787782160.809708:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.809733:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782160.809753:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1874624963107072:192.168.206.16@tcp:104: 00000100:00100000:3.0:1787782160.809854:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67fb5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782160.813257:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.813360:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099520 00000100:00100000:2.0:1787782160.813371:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099520 00010000:00010000:2.0:1787782160.813417:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 25 pid: 18983 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782160.813466:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:2.0:1787782160.813476:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+25:2408:x1874624943099520:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782160.813493:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782160.813501:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 25 pid: 18983 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.813516:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 25 pid: 18983 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.813550:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.813557:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.813565:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.813572:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782160.813798:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064b36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eb0 expref: 25 pid: 18983 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782160.813821:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1874624963106944:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787782160.815669:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:2408:x1874624943099520:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 2179us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782160.815708:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 17 00000100:00100000:1.0:1787782160.827926:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782160.828995:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1874624963107072:192.168.206.16@tcp:104: 00010000:00010000:3.0:1787782160.829031:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782160.829032:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099648 00000100:00100000:0.0:1787782160.829041:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099648 00010000:00010000:0.0:1787782160.829085:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782160.829126:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 18 00000100:00100000:0.0:1787782160.829137:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c436f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:2408:x1874624943099648:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782160.829155:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782160.829164:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829177:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829203:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064b21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ea9 expref: 24 pid: 17209 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829229:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.829235:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829244:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829252:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.829281:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782160.829297:0:17210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.829303:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782160.829325:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1787782160.829348:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c436f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:2408:x1874624943099648:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 213us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.829355:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 18 00010000:00010000:3.0:1787782160.829503:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064b7c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ecc expref: 24 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.829520:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166400/0xc6d6745c15064b83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ecc expref: 23 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782160.829528:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:3.0:1787782160.829531:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787782160.829534:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166400, rc 0) 00000100:00100000:2.0:1787782160.832821:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:15695:x1874624943099392:12345-192.168.206.16@tcp:101:dd.0 Request processed in 26513us (26810us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787782160.832838:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 43 00000100:00100000:2.0:1787782160.835121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.835273:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943099776 00000100:00100000:0.0:1787782160.835286:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943099776 00000100:00100000:0.0:1787782160.835362:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:0.0:1787782160.835373:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+23:15695:x1874624943099776:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:0.0:1787782160.835402:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.835430:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ed3 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835473:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835490:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835524:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835694:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064b91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 25 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835713:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.835723:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.835726:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787782160.835730:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f8600, rc 0) 00000100:00100000:0.0:1787782160.835810:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:15695:x1874624943099776:12345-192.168.206.16@tcp:101:dd.0 Request processed in 439us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.835818:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 44 00000100:00100000:1.0:1787782160.839379:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.839670:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100032 00000100:00100000:2.0:1787782160.839686:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100032 00000100:00100000:2.0:1787782160.839760:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 45 00000100:00100000:2.0:1787782160.839774:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+24:15695:x1874624943100032:12345-192.168.206.16@tcp:36:dd.0 00010000:00010000:2.0:1787782160.841102:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.841131:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.841144:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782160.841567:0:17209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787782160.841998:0:17209:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f06bbf4 reply state 0000000015e032c5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.842017:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.842027:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.842030:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787782160.842035:0:17209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782160.842202:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100032:12345-192.168.206.16@tcp:36:dd.0 Request processed in 2424us (2837us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787782160.842233:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 45 00000020:00080000:2.0:1787782160.842240:0:17209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787782160.847131:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.853318:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100160 00000100:00100000:0.0:1787782160.853337:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100160 00000100:00100000:0.0:1787782160.853419:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:0.0:1787782160.853429:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100160:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:0.0:1787782160.853460:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782160.853487:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064ba6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83eda expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.853680:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eda expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.853698:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eda expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.853734:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782160.853738:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782160.853742:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9000, rc 0) 00000100:00100000:0.0:1787782160.853817:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15695:x1874624943100160:12345-192.168.206.16@tcp:101:dd.0 Request processed in 388us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.853824:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 46 00000100:00100000:3.0:1787782160.872753:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.872937:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100416 00000100:00100000:2.0:1787782160.872951:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100416 00000100:00100000:2.0:1787782160.873046:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:2.0:1787782160.873057:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15695:x1874624943100416:12345-192.168.206.16@tcp:103:dd.0 00010000:00010000:2.0:1787782160.873075:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782160.873107:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9000/0xc6d6745c15064ba6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eda expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.873130:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.873135:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782160.873340:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100416:12345-192.168.206.16@tcp:103:dd.0 Request processed in 284us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782160.873348:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 2 00000100:00100000:2.0:1787782160.876772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782160.876916:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100544 00000100:00100000:0.0:1787782160.876930:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100544 00000100:00100000:0.0:1787782160.877014:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787782160.877027:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100544:12345-192.168.206.16@tcp:58:dd.0 00010000:00010000:0.0:1787782160.877181:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.877203:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782160.877219:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782160.879043:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782160.879870:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787782160.880046:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787782160.880881:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100544:12345-192.168.206.16@tcp:58:dd.0 Request processed in 3846us (4115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782160.880897:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 47 00000100:00100000:0.0:1787782160.883469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782160.883662:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100672 00000100:00100000:2.0:1787782160.883674:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100672 00000100:00100000:2.0:1787782160.883768:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:2.0:1787782160.883782:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+27:15695:x1874624943100672:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:2.0:1787782160.883812:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782160.883838:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ee1 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.883905:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.883936:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.883964:0:17211:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.883979:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.884005:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782160.884010:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782160.884014:0:17211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782160.884024:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43038600, rc 0) 00000100:00100000:2.0:1787782160.884105:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15695:x1874624943100672:12345-192.168.206.16@tcp:101:dd.0 Request processed in 326us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782160.884113:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 48 00000100:00100000:1.0:1787782161.413922:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963107200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787782161.414027:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782161.414141:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963107200 00000100:00100000:2.0:1787782161.414150:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963107200 00000100:00100000:2.0:1787782161.414213:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787782161.414223:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963107200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787782161.414264:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000040:00080000:0.0:1787782161.415526:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787782161.415540:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782161.415569:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787782161.415577:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787782161.415759:0:17246:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17246:1874624963107328:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787782161.415853:0:17246:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c43027900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782161.416061:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963107456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787782161.416110:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782161.416174:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963107456 00000100:00100000:0.0:1787782161.416181:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963107456 00000100:00100000:0.0:1787782161.416222:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782161.416243:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963107456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787782161.416277:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787782161.416326:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963107456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.416334:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782161.416384:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963107456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787782161.423184:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874624963107200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8949us (9143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.423203:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782161.423570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782161.423703:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100800 00000100:00100000:3.0:1787782161.423715:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100800 00000100:00100000:3.0:1787782161.423775:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:3.0:1787782161.423785:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943100800:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787782161.423823:0:17209:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787782161.423978:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943100800:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 193us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.423997:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 49 00000100:00100000:2.0:1787782161.424821:0:17246:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43ed4780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17246:1874624963107328:192.168.206.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782161.425313:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43764780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1874624963107200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787782161.427433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.427548:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943100928 00000100:00100000:2.0:1787782161.427562:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943100928 00000100:00100000:2.0:1787782161.427713:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:2.0:1787782161.427724:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15696:x1874624943100928:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787782161.427822:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.427843:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.428971:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430234:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430260:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430272:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430302:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430311:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.430318:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782161.430379:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787782161.430383:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787782161.431292:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431312:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431319:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431326:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431332:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039800 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.431336:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431344:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431360:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993c42528100) 00010000:00010000:2.0:1787782161.431364:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.431369:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431376:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039800/0xc6d6745c15064bbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431392:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431428:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431434:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431439:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.431443:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431449:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431457:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff993c436a6300) 00010000:00010000:2.0:1787782161.431460:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.431462:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431469:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431485:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431492:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431497:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431502:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.431511:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431518:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431526:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782161.431528:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.431531:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.431537:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.431744:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15696:x1874624943100928:12345-192.168.206.16@tcp:34:lhsmtool_posix.0 Request processed in 4016us (4316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.431755:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 50 00000100:00100000:3.0:1787782161.439925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.440028:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943101184 00000100:00100000:2.0:1787782161.440043:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943101184 00000100:00100000:2.0:1787782161.440114:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:2.0:1787782161.440125:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+28:15696:x1874624943101184:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782161.440144:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782161.440164:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ee8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440280:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440296:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440328:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782161.440342:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787782161.440433:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440442:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440449:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440456:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.440461:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440468:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440481:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782161.440485:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787782161.440489:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440494:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440538:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bd0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee8 expref: 30 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440564:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff993c42528100) 00010000:00010000:2.0:1787782161.440567:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782161.440572:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039e00/0xc6d6745c15064bd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee8 expref: 30 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.440582:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039e00, rc 0) 00000100:00100000:2.0:1787782161.440710:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943101184:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 586us (797us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787782161.440718:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 51 00000100:00100000:0.0:1787782161.444716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.444838:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943101312 00000100:00100000:1.0:1787782161.444849:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943101312 00000100:00100000:1.0:1787782161.444908:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:1.0:1787782161.444919:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943101312:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787782161.444957:0:18983:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787782161.445087:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943101312:12345-192.168.206.16@tcp:53:lhsmtool_posix.0 Request processed in 169us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.445096:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 52 00000100:00100000:3.0:1787782161.452573:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.452825:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943101568 00000100:00100000:0.0:1787782161.452840:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943101568 00000100:00100000:0.0:1787782161.453135:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:0.0:1787782161.453147:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+29:15696:x1874624943101568:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782161.453166:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782161.453188:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8e00/0xc6d6745c15064be5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83eef expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782161.453542:0:17210:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1787782161.453563:0:17210:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787782161.453582:0:17210:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787782161.453756:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9c00/0xc6d6745c15064bec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.453777:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9c00/0xc6d6745c15064bec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.453787:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9c00/0xc6d6745c15064bec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.453835:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8e00/0xc6d6745c15064be5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eef expref: 32 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.453852:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9c00/0xc6d6745c15064bec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eef expref: 31 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.453861:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d77c03300) 00010000:00010000:0.0:1787782161.453864:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782161.453867:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d773f9c00, rc 0) 00000100:00100000:0.0:1787782161.453952:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+31:15696:x1874624943101568:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 807us (1395us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787782161.453959:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 53 00000100:00100000:3.0:1787782161.462947:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.463101:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943101824 00000100:00100000:1.0:1787782161.463111:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943101824 00000100:00100000:1.0:1787782161.463169:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:1.0:1787782161.463177:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+31:15696:x1874624943101824:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787782161.463229:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782161.463252:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9c00/0xc6d6745c15064bec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83eef expref: 31 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463270:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d77c03300) 00010000:00010000:1.0:1787782161.463279:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782161.463300:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463313:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463322:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463336:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463355:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463363:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463413:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463420:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463427:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463433:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a5000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782161.463437:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463444:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463452:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:1.0:1787782161.463455:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782161.463459:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463465:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5000/0xc6d6745c15064bfa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463474:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463485:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463491:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463496:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a5e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:1.0:1787782161.463499:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463506:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463513:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x47a5b2ae (ffff993c42528d00) 00010000:00010000:1.0:1787782161.463515:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782161.463517:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.463523:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c01 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x47a5b2ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782161.463598:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+30:15696:x1874624943101824:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 421us (665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782161.463656:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 54 00000100:00100000:2.0:1787782161.470665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782161.470753:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943101952 00000100:00100000:3.0:1787782161.470765:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943101952 00000100:00100000:3.0:1787782161.470824:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:3.0:1787782161.470834:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+30:15696:x1874624943101952:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782161.470853:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782161.470873:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064c08 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83ef6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.470906:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064c0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.470919:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064c0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.470930:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064c0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.471053:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064c08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ef6 expref: 32 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.471071:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82166200/0xc6d6745c15064c0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ef6 expref: 31 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.471079:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:3.0:1787782161.471082:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787782161.471085:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82166200, rc 0) 00000100:00100000:3.0:1787782161.471155:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+31:15696:x1874624943101952:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 314us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.471172:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 55 00000100:00100000:3.0:1787782161.475562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.475724:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943102208 00000100:00100000:1.0:1787782161.475734:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943102208 00000100:00100000:1.0:1787782161.475796:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:1.0:1787782161.475807:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+31:15696:x1874624943102208:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787782161.475889:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.475917:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.475936:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782161.476106:0:18983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787782161.476116:0:18983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 598557507735ns, next at 599557505411ns, rc = 0 00000004:00010000:1.0:1787782161.476158:0:18983:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000547b28e9 reply state 00000000a1944d75 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.476171:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.476179:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:1.0:1787782161.476182:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787782161.476185:0:18983:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782161.476289:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+33:15696:x1874624943102208:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 483us (737us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787782161.476297:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 56 00000100:00100000:0.0:1787782161.483667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.483763:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943102336 00000100:00100000:2.0:1787782161.483773:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943102336 00000100:00100000:2.0:1787782161.483840:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:2.0:1787782161.483850:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+33:15696:x1874624943102336:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782161.483871:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782161.484053:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83efd expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.484105:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 34 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.484119:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 34 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.484135:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:2.0:1787782161.484148:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782161.484151:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d43039000, rc 0) 00000100:00100000:2.0:1787782161.484202:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+34:15696:x1874624943102336:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 354us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.484209:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 57 00000100:00100000:0.0:1787782161.489288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.489404:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943102464 00000100:00100000:1.0:1787782161.489413:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943102464 00000100:00080000:3.0:1787782161.489473:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782161.489484:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:1.0:1787782161.489495:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2409:x1874624943102464:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787782161.489806:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d506ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2409:x1874624943102464:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 312us (525us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787782161.489814:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:3.0:1787782161.505981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.506251:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943102720 00000100:00100000:1.0:1787782161.506267:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943102720 00000100:00100000:1.0:1787782161.506326:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:1.0:1787782161.506336:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+34:15696:x1874624943102720:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787782161.506823:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+35:15696:x1874624943102720:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 486us (847us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787782161.506831:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 9 00000100:00100000:0.0:1787782161.510176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.510319:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943102976 00000100:00100000:1.0:1787782161.510328:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943102976 00000100:00100000:1.0:1787782161.510385:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:1.0:1787782161.510410:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+35:15696:x1874624943102976:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787782161.510539:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+35:15696:x1874624943102976:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 145us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.510547:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 58 00000100:00100000:0.0:1787782161.512880:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:3.0:1787782161.513027:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943103104 00000100:00100000:3.0:1787782161.513045:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943103104 00000100:00100000:3.0:1787782161.513099:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:3.0:1787782161.513109:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+35:15696:x1874624943103104:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782161.513129:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782161.513147:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064c24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83f04 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513233:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513247:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513258:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782161.513301:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787782161.513320:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513345:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167000/0xc6d6745c15064c24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f04 expref: 37 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513362:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f04 expref: 36 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.513377:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:3.0:1787782161.513380:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787782161.513383:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993d82167e00, rc 0) 00000100:00100000:3.0:1787782161.513965:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+36:15696:x1874624943103104:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 855us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.513974:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 59 00000100:00100000:3.0:1787782161.521798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.521938:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943103232 00000100:00100000:1.0:1787782161.521951:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943103232 00000100:00100000:1.0:1787782161.522036:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:1.0:1787782161.522048:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d47801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2408:x1874624943103232:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782161.522074:0:18718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782161.522110:0:18718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83f0b expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782161.522162:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6411, blocks: 0x0 00010000:00010000:1.0:1787782161.522192:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=598s v=(0 0) 00010000:00010000:1.0:1787782161.522198:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782161.522212:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.522268:0:18718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.522285:0:18718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a4c00, rc 0) 00000100:00100000:1.0:1787782161.522728:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d47801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2408:x1874624943103232:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 336us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.522738:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:1.0:1787782161.526035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.526156:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943103488 00000100:00100000:0.0:1787782161.526169:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943103488 00000100:00100000:0.0:1787782161.526241:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:0.0:1787782161.526252:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+36:15696:x1874624943103488:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787782161.526401:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+36:15696:x1874624943103488:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 151us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.526409:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 60 00000100:00100000:2.0:1787782161.539287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.539412:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943103616 00000100:00100000:0.0:1787782161.539422:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943103616 00000100:00100000:0.0:1787782161.539479:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 61 00000100:00100000:0.0:1787782161.539491:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+36:15696:x1874624943103616:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787782161.546728:0:17189:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787782161.546750:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787782161.546815:0:17189:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787782161.547016:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15696:x1874624943103616:12345-192.168.206.16@tcp:44:lhsmtool_posix.0 Request processed in 7520us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.547028:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 61 00010000:00010000:3.0:1787782161.548368:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548398:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548407:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548414:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782161.548419:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548429:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548449:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:3.0:1787782161.548453:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787782161.548459:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.548467:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8200/0xc6d6745c15064abf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782161.551079:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963107584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787782161.551190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.554703:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963107584 00000100:00100000:1.0:1787782161.554724:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963107584 00000100:00100000:1.0:1787782161.554845:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782161.554859:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874624963107584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787782161.555050:0:18717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787782161.555055:0:18717:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787782161.555057:0:18717:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787782161.555059:0:18717:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787782161 -> 1787782161 00002000:00010000:1.0:1787782161.555062:0:18717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787782161.555169:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1874624963107584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 314us (3979us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787782161.555178:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787782161.555373:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787782161.555435:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff993d67f661c0/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787782161.555443:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963107584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787782161.556804:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.556974:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943103744 00000100:00100000:1.0:1787782161.556995:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943103744 00000100:00100000:1.0:1787782161.557053:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 24 00000100:00100000:1.0:1787782161.557064:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2409:x1874624943103744:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787782161.557204:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43765e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2409:x1874624943103744:12345-192.168.206.16@tcp:16:lhsmtool_posix.0 Request processed in 142us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.557213:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 24 00010000:00010000:2.0:1787782161.561563:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561588:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561597:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561603:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.561623:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561632:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561653:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff993c436a6000) 00010000:00010000:2.0:1787782161.561657:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.561663:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561670:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064a6b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561698:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561722:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561729:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561734:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.561738:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561745:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561754:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff993c436a6c00) 00010000:00010000:2.0:1787782161.561757:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.561760:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561766:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039a00/0xc6d6745c15064a72 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561782:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561788:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561795:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561800:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a4400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.561809:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561816:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561824:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff993c42528400) 00010000:00010000:2.0:1787782161.561826:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.561830:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561836:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a4400/0xc6d6745c15064b1a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561854:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561860:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561866:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561871:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039200 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.561873:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561880:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561888:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782161.561891:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.561901:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561907:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064b9f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561920:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561927:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561933:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.561939:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993c425a5e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.561942:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.562030:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.562038:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:2.0:1787782161.562041:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787782161.562044:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.562050:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5e00/0xc6d6745c15064c16 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782161.573216:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.573376:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104000 00000100:00100000:2.0:1787782161.573677:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104000 00000100:00100000:2.0:1787782161.573758:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:2.0:1787782161.573789:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+15:15696:x1874624943104000:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787782161.573874:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782161.573912:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d82167e00/0xc6d6745c15064c2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f04 expref: 15 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.573940:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:2.0:1787782161.574086:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782161.574130:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064c39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.574147:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.574159:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782161.574523:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6f4238 reply state 0000000018d3a84f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.574539:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039200/0xc6d6745c15064c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.574546:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:2.0:1787782161.574549:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787782161.574553:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782161.575189:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+16:15696:x1874624943104000:12345-192.168.206.16@tcp:36:lhsmtool_posix.0 Request processed in 1398us (1984us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787782161.575201:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 62 00000100:00100000:3.0:1787782161.577303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.577522:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104128 00000100:00100000:1.0:1787782161.577532:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104128 00000100:00100000:1.0:1787782161.577602:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:1.0:1787782161.577654:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:15696:x1874624943104128:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782161.577673:0:18718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782161.577699:0:18718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83f12 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.577855:0:18718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.577866:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782161.577870:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782161.577876:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 8 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.577907:0:18718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.577921:0:18718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782161.577955:0:18718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18718:1874624963107712:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787782161.578244:0:18718:0:(client.c:2715:ptlrpc_set_wait()) set ffff993c430423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782161.583549:0:18718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43edde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18718:1874624963107712:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782161.583586:0:18718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 8 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.583636:0:18718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5600, rc 0) 00000100:00100000:1.0:1787782161.583700:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:15696:x1874624943104128:12345-192.168.206.16@tcp:101:lhsmtool_posix.0 Request processed in 6047us (6405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.583711:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 25 00000100:00100000:2.0:1787782161.594363:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.594536:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104256 00000100:00100000:0.0:1787782161.594552:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104256 00010000:00010000:0.0:1787782161.594660:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.594710:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:0.0:1787782161.594721:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:2408:x1874624943104256:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782161.594742:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782161.594789:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.594806:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.594834:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ed1d2be/0xc6d6745c15064c32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f0b expref: 8 pid: 18718 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.594856:0:17194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782161.594860:0:17194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782161.594867:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 7 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.594878:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 7 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.594925:0:17194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 7 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.594940:0:17194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17194:1874624963107840:192.168.206.16@tcp:105: 00000100:00100000:0.0:1787782161.595050:0:17194:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d46578900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782161.603413:0:17194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17194:1874624963107840:192.168.206.16@tcp:105: 00010000:00010000:0.0:1787782161.603446:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782161.603518:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2408:x1874624943104256:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 8798us (9176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.603551:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 19 00000100:00100000:2.0:1787782161.603975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.604089:0:19602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104384 00000100:00100000:0.0:1787782161.604098:0:19602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104384 00000100:00100000:0.0:1787782161.604153:0:19602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:0.0:1787782161.604162:0:19602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2409:x1874624943104384:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787782161.604479:0:19602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787782161.604483:0:19602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787782160 00002000:00010000:0.0:1787782161.604485:0:19602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787782159 00002000:00010000:0.0:1787782161.604487:0:19602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787782161 -> 1787782160 00002000:00010000:0.0:1787782161.604490:0:19602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787782161.604540:0:19602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:2409:x1874624943104384:12345-192.168.206.16@tcp:2:lhsmtool_posix.0 Request processed in 377us (566us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787782161.604548:0:19602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:1.0:1787782161.623385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.623488:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104512 00000100:00100000:0.0:1787782161.623506:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104512 00000100:00100000:0.0:1787782161.623597:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:0.0:1787782161.623650:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:2408:x1874624943104512:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787782161.623711:0:19601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.623737:0:19601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 8 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.623754:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782161.623759:0:19601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782161.623784:0:19601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.623846:0:19601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 8 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.623864:0:19601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 8 pid: 18718 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.623881:0:19601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19601:1874624963107968:192.168.206.16@tcp:104: 00000100:00100000:1.0:1787782161.624124:0:19601:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d46578900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782161.630096:0:19601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19601:1874624963107968:192.168.206.16@tcp:104: 00010000:00010000:1.0:1787782161.630129:0:19601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782161.636888:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.637018:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104640 00000100:00100000:2.0:1787782161.637037:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104640 00010000:00010000:2.0:1787782161.637105:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 9 pid: 18718 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.637167:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 20 00000100:00100000:2.0:1787782161.637179:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+9:2409:x1874624943104640:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782161.637199:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782161.637450:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 9 pid: 18718 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.637470:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 9 pid: 18718 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.637504:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b34989/0xc6d6745c15064c40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f12 expref: 9 pid: 18718 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.637527:0:17196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782161.637532:0:17196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782161.637539:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.637551:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.637591:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782161.637855:0:19601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.637864:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:2409:x1874624943104640:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 684us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.637881:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 20 00010000:00010000:1.0:1787782161.637894:0:19601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.637950:0:19601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.637969:0:19601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.637978:0:19601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.637996:0:19601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:1.0:1787782161.638000:0:19601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.638009:0:19601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.638027:0:19601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.638035:0:19601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5f919a/0xc6d6745c15064c47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782161.638114:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+7:2408:x1874624943104512:12345-192.168.206.16@tcp:1:lhsmtool_posix.0 Request processed in 14504us (14753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.638134:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:3.0:1787782161.649375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.649513:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943104896 00000100:00100000:0.0:1787782161.649531:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943104896 00000100:00100000:0.0:1787782161.649658:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 63 00000100:00100000:0.0:1787782161.649671:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+16:15696:x1874624943104896:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787782161.649790:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.649815:0:17209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.649838:0:17209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.649887:0:17209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.649904:0:17209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 16 pid: 17211 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.649953:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108096:192.168.206.16@tcp:104: 00000100:00100000:0.0:1787782161.650073:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d46578900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782161.658863:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108096:192.168.206.16@tcp:104: 00010000:00010000:0.0:1787782161.658905:0:17209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782161.668808:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.668972:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105024 00000100:00100000:0.0:1787782161.668996:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105024 00010000:00010000:0.0:1787782161.669054:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 17 pid: 17211 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.669104:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 21 00000100:00100000:0.0:1787782161.669116:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+17:2409:x1874624943105024:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782161.669134:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782161.669141:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 17 pid: 17211 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669155:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 17 pid: 17211 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669183:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f8600/0xc6d6745c15064b98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ed3 expref: 17 pid: 17211 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669203:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:0.0:1787782161.669210:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669239:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669247:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.669256:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.669476:0:17209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.669486:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.670231:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782161.670335:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+16:2409:x1874624943105024:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 1216us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.670347:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 21 00010000:00010000:2.0:1787782161.671108:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.671129:0:17209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 16 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.671138:0:17209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.671179:0:17209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 16 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.671196:0:17209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 16 pid: 17210 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.671212:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108224:192.168.206.16@tcp:104: 00000100:00100000:2.0:1787782161.671368:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357240 going to sleep for 11 seconds 00000100:00100000:3.0:1787782161.684426:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.684654:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105152 00000100:00100000:0.0:1787782161.684665:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105152 00010000:00010000:0.0:1787782161.684721:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 17 pid: 17210 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782161.684766:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 22 00000100:00100000:0.0:1787782161.684776:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+17:2408:x1874624943105152:12345-192.168.206.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782161.684797:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782161.684805:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 17 pid: 17210 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.684821:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 17 pid: 17210 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.684873:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:0.0:1787782161.684879:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.684890:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.684900:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782161.684923:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782161.685008:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9e9e90-3be8-496e-9d8c-b3039adccc53+17:2408:x1874624943105152:12345-192.168.206.16@tcp:103:ldlm_bl.0 Request processed in 232us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.685017:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 22 00010000:00010000:2.0:1787782161.685136:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83efd expref: 16 pid: 17210 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.685157:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108224:192.168.206.16@tcp:104: 00010000:00010000:2.0:1787782161.685182:0:17209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.685193:0:17209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.685207:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782161.685368:0:17209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787782161.685505:0:17209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787782161.685546:0:17209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787782161.685733:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17209:1874624963108352:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787782161.685796:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782161.685827:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782161.686084:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963108352 00000100:00100000:0.0:1787782161.686091:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963108352 00000100:00100000:0.0:1787782161.686141:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782161.686150:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17209:x1874624963108352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787782161.686242:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17209:x1874624963108352:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.686249:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787782161.687557:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17209:1874624963108352:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787782161.687847:0:17209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787782161.687936:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17209:1874624963108480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787782161.688010:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782161.688043:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d77357840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782161.689474:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963108480 00000100:00100000:0.0:1787782161.689489:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963108480 00000100:00100000:0.0:1787782161.689570:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787782161.689581:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17209:x1874624963108480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787782161.689847:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17209:x1874624963108480:12345-0@lo:1000:mdt00_000.0 Request processed in 267us (1835us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787782161.689863:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787782161.690196:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43c6bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17209:1874624963108480:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787782161.690260:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690272:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690293:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690307:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039400 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782161.690313:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690330:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690350:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:3.0:1787782161.690354:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782161.690360:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690367:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039400/0xc6d6745c15064c55 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690408:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690414:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690421:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690426:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9a00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:3.0:1787782161.690430:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690436:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690445:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:3.0:1787782161.690447:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782161.690455:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690480:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690491:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.690557:0:17209:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038600/0xc6d6745c15064bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83ee1 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782161.690574:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c437512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108608:192.168.206.16@tcp:105: 00000100:00100000:3.0:1787782161.690705:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff993d67fb5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782161.692999:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c437512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17209:1874624963108608:192.168.206.16@tcp:105: 00010000:00010000:2.0:1787782161.693033:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693046:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9a00/0xc6d6745c15064bad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693086:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693101:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693113:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693142:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693148:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693155:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693161:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038000 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.693165:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693173:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693186:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782161.693189:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782161.693192:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693197:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43038000/0xc6d6745c15064c5c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693206:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693212:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693218:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693231:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f9e00 already unused, calling callback (ffffffffc182f4f0) 00010000:00010000:2.0:1787782161.693234:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693239:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693248:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:2.0:1787782161.693250:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787782161.693253:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.693259:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d773f9e00/0xc6d6745c15064c4e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782161.693477:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15696:x1874624943104896:12345-192.168.206.16@tcp:57:lhsmtool_posix.0 Request processed in 43807us (44121us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787782161.693488:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 63 00000020:00080000:2.0:1787782161.693496:0:17209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787782161.694005:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787782161.694011:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782161.694048:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787782161.694055:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787782161.694344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.694536:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105280 00000100:00100000:2.0:1787782161.694545:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105280 00000100:00100000:2.0:1787782161.694601:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:2.0:1787782161.694639:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43d3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15695:x1874624943105280:12345-192.168.206.16@tcp:49:dd.0 00000100:00100000:2.0:1787782161.694764:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43d3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15695:x1874624943105280:12345-192.168.206.16@tcp:49:dd.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.694772:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 10 00000100:00100000:1.0:1787782161.695904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.696238:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105536 00000100:00100000:2.0:1787782161.696248:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105536 00000100:00100000:2.0:1787782161.696479:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 11 00000100:00100000:2.0:1787782161.696490:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+19:15696:x1874624943105536:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787782161.700124:0:17213:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787782161.700181:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787782161.700313:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700331:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700342:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700351:0:17213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700358:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700365:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.700390:0:17213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782161.700497:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15696:x1874624943105536:12345-192.168.206.16@tcp:35:lhsmtool_posix.0 Request processed in 4004us (4596us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787782161.700507:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 11 00000020:00080000:2.0:1787782161.700513:0:17213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787782161.701308:0:19545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782161.701324:0:19545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.701335:0:19545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43039000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:3.0:1787782161.701339:0:19545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.701349:0:19545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.701367:0:19545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff993d6d095e00) 00010000:00010000:3.0:1787782161.701370:0:19545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787782161.701376:0:19545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.701382:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993d43039000/0xc6d6745c15064c63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782161.701416:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782161.701418:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782161.701420:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782161.701897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:1.0:1787782161.701993:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105664 00000100:00100000:1.0:1787782161.702004:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105664 00000100:00100000:1.0:1787782161.702073:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 64 00000100:00100000:1.0:1787782161.702085:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+21:15695:x1874624943105664:12345-192.168.206.16@tcp:101:dd.0 00010000:00010000:1.0:1787782161.702110:0:18983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782161.702131:0:18983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5400/0xc6d6745c15064c6a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc940ae6edb83f19 expref: -99 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702169:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5c00/0xc6d6745c15064c71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702184:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5c00/0xc6d6745c15064c71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702196:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5c00/0xc6d6745c15064c71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702354:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5400/0xc6d6745c15064c6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f19 expref: 23 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702373:0:18983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff993c425a5c00/0xc6d6745c15064c71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.16@tcp remote: 0xdc940ae6edb83f19 expref: 22 pid: 18983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782161.702381:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff993c42528600) 00010000:00010000:1.0:1787782161.702384:0:18983:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782161.702387:0:18983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff993c425a5c00, rc 0) 00000100:00100000:1.0:1787782161.702465:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+22:15695:x1874624943105664:12345-192.168.206.16@tcp:101:dd.0 Request processed in 382us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.702473:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 64 00010000:00010000:3.0:1787782161.798510:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782161.926074:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963108992:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926172:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926218:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963109504:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926241:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926256:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963110016:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926291:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926327:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787782161.926333:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963108864:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926358:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926378:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963109376:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926400:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926415:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963109888:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926435:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.926468:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963108864 00000100:00100000:1.0:1787782161.926478:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963108864 00000100:00100000:1.0:1787782161.926527:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109376 00000100:00100000:1.0:1787782161.926530:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109376 00000100:00100000:1.0:1787782161.926563:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787782161.926572:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963108864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926658:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963108864:12345-0@lo:400:kworker.0 Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.926665:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787782161.926683:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787782161.926706:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963109376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926735:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963109376:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.926742:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787782161.926779:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963108864:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926790:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963109376:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926824:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963108992 00000100:00100000:1.0:1787782161.926828:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963108992 00000100:00100000:1.0:1787782161.926853:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109504 00000100:00100000:1.0:1787782161.926856:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109504 00000100:00100000:1.0:1787782161.926885:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782161.926891:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3658:x1874624963108992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926929:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c431a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3658:x1874624963108992:12345-0@lo:400:kworker.0 Request processed in 39us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.926935:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782161.926946:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782161.926952:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963109504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.926978:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963109504:12345-0@lo:400:kworker.0 Request processed in 26us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.926994:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782161.927023:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963108992:0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.927033:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963109504:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927378:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d491621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963108736:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927420:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927457:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963109248:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927479:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927492:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963109760:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927508:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927520:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963110272:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927547:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927560:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787782161.927566:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963109120:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927587:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927604:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963109632:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927660:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782161.927679:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963110144:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927697:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787782161.927717:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782161.927729:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109120 00000100:00100000:3.0:1787782161.927732:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109120 00000100:00100000:3.0:1787782161.927760:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109632 00000100:00100000:3.0:1787782161.927762:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109632 00000100:00100000:3.0:1787782161.927777:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782161.927782:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927826:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874624963109120:12345-0@lo:400:kworker.0 Request processed in 44us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.927833:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787782161.927847:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787782161.927852:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927878:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874624963109632:12345-0@lo:400:kworker.0 Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.927885:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787782161.927898:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782161.927917:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1874624963109120:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.927927:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1874624963109632:0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.928729:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110016 00000100:00100000:2.0:1787782161.928737:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110016 00000100:00080000:2.0:1787782161.928766:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787782161.928792:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109888 00000100:00100000:2.0:1787782161.928807:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109888 00000100:00080000:2.0:1787782161.928821:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782161.928837:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109248 00000100:00100000:2.0:1787782161.928840:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109248 00000100:00100000:2.0:1787782161.928855:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963109760 00000100:00100000:2.0:1787782161.928858:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963109760 00000100:00100000:2.0:1787782161.928870:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110272 00000100:00100000:2.0:1787782161.928872:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110272 00000100:00080000:2.0:1787782161.928885:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787782161.928897:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110144 00000100:00100000:2.0:1787782161.928900:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110144 00000100:00080000:2.0:1787782161.928910:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782161.928923:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787782161.928930:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963110016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.929123:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874624963110016:12345-0@lo:400:kworker.0 Request processed in 192us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.929131:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787782161.929173:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd5680 x1874624963110016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782161.929188:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1874624963110016:0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.929212:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787782161.929219:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.929255:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d44eb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874624963109888:12345-0@lo:400:kworker.0 Request processed in 38us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782161.929262:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787782161.930812:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963110656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782161.931779:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1874624963109888:0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.931813:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963110528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782161.931828:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782161.931876:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782161.931991:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963108736 00000100:00100000:1.0:1787782161.931999:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963108736 00000100:00100000:3.0:1787782161.932074:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787782161.932092:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963109248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.932163:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874624963109248:12345-0@lo:400:kworker.0 Request processed in 79us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.932172:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782161.932289:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782161.932424:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110656 00000100:00100000:0.0:1787782161.932429:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110656 00000100:00100000:1.0:1787782161.932461:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787782161.932463:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110528 00000100:00100000:0.0:1787782161.932468:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110528 00000100:00100000:1.0:1787782161.932485:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3660:x1874624963108736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.932540:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:919c9bfc-060e-4da8-a874-7b13cf1bdaec+24:3660:x1874624963108736:12345-0@lo:400:kworker.0 Request processed in 47us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.932547:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787782161.932583:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782161.932591:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963110656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782161.932638:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787782161.932685:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874624963110656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.932693:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782161.932711:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782161.932718:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963110528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782161.932733:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787782161.932762:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874624963110528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.932769:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787782161.932775:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1874624963110656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782161.932798:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787782161.932808:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963109760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782161.932834:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787782161.932848:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874624963109760:12345-0@lo:400:kworker.0 Request processed in 39us (5335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.932848:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963110272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782161.932862:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787782161.932883:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787782161.932893:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782161.932899:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874624963110272:12345-0@lo:400:kworker.0 Request processed in 55us (5349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782161.932908:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787782161.932937:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c437521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874624963110144:12345-0@lo:400:kworker.0 Request processed in 46us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782161.932955:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787782161.933042:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993c43e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874624963109248:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.933064:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874624963109760:0@lo:400:kworker.0 00010000:00080000:3.0:1787782161.933080:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff993d67fd6580 x1874624963110272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782161.933091:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1874624963110272:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.933117:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d67fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1874624963110144:0@lo:400:kworker.0 00000100:00100000:3.0:1787782161.933126:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d491621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:919c9bfc-060e-4da8-a874-7b13cf1bdaec:3660:1874624963108736:0@lo:400:kworker.0 00000100:00100000:2.0:1787782161.933254:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963110400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787782161.933292:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782161.933411:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1874624963110528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782161.935746:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110400 00000100:00100000:3.0:1787782161.935765:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110400 00000100:00100000:3.0:1787782161.935850:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787782161.935862:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963110400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787782161.935897:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787782161.936032:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874624963110400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782161.936040:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782161.937763:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d4bf2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1874624963110400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787782161.957750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:0.0:1787782161.957810:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782161.957907:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105792 00000100:00100000:2.0:1787782161.957921:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105792 00000100:00100000:2.0:1787782161.958012:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943105920 00000100:00100000:2.0:1787782161.958016:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943105920 00000100:00100000:2.0:1787782161.958045:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:2.0:1787782161.958056:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+8:2408:x1874624943105792:12345-192.168.206.16@tcp:4:dd.0 00002000:00010000:2.0:1787782161.958123:0:18722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f6410, atime: 0x6a8f640f, ctime: 0x6a8f6410, blocks: 0x0 00010000:00010000:2.0:1787782161.958132:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.958153:0:18722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=599s v=(0 0) 00010000:00010000:2.0:1787782161.958158:0:18722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782161.958167:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782161.958185:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782162.065090:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1787782162.065114:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1787782162.065534:0:18722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787782162.065540:0:18722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787782160 -> 1787782161 00002000:00010000:0.0:1787782162.065543:0:18722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787782160 -> 1787782161 00002000:00010000:0.0:1787782162.065545:0:18722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1787782162.065565:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065587:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065596:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065604:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d43038000 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782162.065641:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065651:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065674:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.065682:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb97f0b5/0xc6d6745c15064c78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782162.065863:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+6:2408:x1874624943105792:12345-192.168.206.16@tcp:4:dd.0 Request processed in 107802us (108119us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787782162.065881:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 0 00000100:00100000:0.0:1787782162.065919:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 1 00000100:00100000:0.0:1787782162.065932:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2409:x1874624943105920:12345-192.168.206.16@tcp:4:dd.0 00002000:00010000:0.0:1787782162.066003:0:18722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a8f6411, atime: 0x6a8f640f, ctime: 0x6a8f6411, blocks: 0x2000 00010000:00010000:0.0:1787782162.066016:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.066029:0:18722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=599s v=(0 0) 00010000:00010000:0.0:1787782162.066034:0:18722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782162.066041:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.066054:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782162.140346:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1787782162.142273:0:18722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1787782162.142287:0:18722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1787782162.142321:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142336:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142346:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142354:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff993d773f8a00 already unused, calling callback (ffffffffc0c1c420) 00010000:00010000:0.0:1787782162.142359:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142370:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142419:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782162.142427:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e96ed6be/0xc6d6745c15064c7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782162.142576:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bf2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2409:x1874624943105920:12345-192.168.206.16@tcp:4:dd.0 Request processed in 76641us (184758us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787782162.142588:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 1 00000040:00080000:0.0:1787782162.757797:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787782162.757807:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782162.757827:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787782162.757835:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787782162.821850:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782163.848183:0:19545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782163.858087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858206:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858264:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858283:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858309:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.16@tcp (source: 12345-192.168.206.16@tcp) 00000100:00100000:2.0:1787782163.858349:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106304 00000100:00100000:2.0:1787782163.858913:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106304 00000100:00100000:2.0:1787782163.859005:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106816 00000100:00100000:2.0:1787782163.859009:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106816 00000100:00100000:2.0:1787782163.859025:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106176 00000100:00100000:2.0:1787782163.859028:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106176 00000100:00100000:2.0:1787782163.859041:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106688 00000100:00100000:2.0:1787782163.859044:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106688 00000100:00100000:2.0:1787782163.859066:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:2.0:1787782163.859078:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106304:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859188:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106304:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 112us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859197:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 72 00000100:00100000:2.0:1787782163.859221:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:2.0:1787782163.859228:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943106816:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859252:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943106816:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859258:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 73 00000100:00100000:2.0:1787782163.859288:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:2.0:1787782163.859294:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+22:2408:x1874624943106176:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859326:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9e9e90-3be8-496e-9d8c-b3039adccc53+22:2408:x1874624943106176:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 33us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859332:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 74 00000100:00100000:2.0:1787782163.859344:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:2.0:1787782163.859350:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2408:x1874624943106688:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859377:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0e00f26-a408-40f6-8a81-b71e91755e01+6:2408:x1874624943106688:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859384:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 75 00000100:00100000:2.0:1787782163.859413:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106560 00000100:00100000:2.0:1787782163.859417:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106560 00000100:00100000:2.0:1787782163.859450:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943107072 00000100:00100000:2.0:1787782163.859454:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943107072 00000100:00100000:2.0:1787782163.859469:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106432 00000100:00100000:2.0:1787782163.859471:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106432 00000100:00100000:2.0:1787782163.859485:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106944 00000100:00100000:2.0:1787782163.859488:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106944 00000100:00100000:2.0:1787782163.859502:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:2.0:1787782163.859509:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106560:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859538:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106560:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 29us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859544:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 26 00000100:00100000:2.0:1787782163.859555:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:2.0:1787782163.859561:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943107072:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859586:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943107072:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 25us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859601:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 27 00000100:00100000:2.0:1787782163.859641:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:2.0:1787782163.859648:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106432:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859678:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993c43ed4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e9e9e90-3be8-496e-9d8c-b3039adccc53+5:2408:x1874624943106432:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 30us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859684:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 28 00000100:00100000:2.0:1787782163.859696:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00100000:2.0:1787782163.859702:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943106944:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:2.0:1787782163.859725:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d799b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0e00f26-a408-40f6-8a81-b71e91755e01+5:2408:x1874624943106944:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 24us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782163.859732:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 29 00000100:00080000:2.0:1787782163.859771:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782163.859776:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782163.859779:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787782163.859782:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787782163.859942:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624943106048 00000100:00100000:1.0:1787782163.859947:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624943106048 00000100:00100000:1.0:1787782163.859995:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.16@tcp, seq: 169 00000100:00100000:1.0:1787782163.860002:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2408:x1874624943106048:12345-192.168.206.16@tcp:400:kworker.0 00000100:00100000:1.0:1787782163.860027:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d67cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a82bbaac-ff23-4e9c-aac0-3e7ff68d6307+13:2408:x1874624943106048:12345-192.168.206.16@tcp:400:kworker.0 Request processed in 26us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782163.860033:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.16@tcp, seq: 169 00000001:02000400:0.0:1787782164.135374:0:20387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787782164.874353:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782165.000951:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782165.000999:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff993d44eb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963110784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787782165.001096:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782165.001274:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874624963110784 00000100:00100000:1.0:1787782165.001283:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874624963110784 00000100:00100000:1.0:1787782165.001362:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782165.001374:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff993d4bea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963110784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787782165.001411:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787782165.001468:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff993d4bea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874624963110784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782165.001475:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782165.001540:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff993d44eb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1874624963110784:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787782165.002480:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787782165.899859:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43263 lines, 43263 kept, 0 dropped, 0 bad.